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(54) Interpolating operation method and apparatus for image signals 



(57) An original image signal, which represents an 
original image and are composed of original image sig- 
nal components representing a plurality of sampling 
points, that are arrayed at predetermined intervals and 
in a lattice-like form, is obtained^ A judgment is made as 
to whether an interpolation point belongs to an image 
edge portion, at which the change in the original image 
signal is sharp, or belongs to a flat portion, at which the 
change in the original image signal is unsharp. Interpo- 
lating operation processes, one of which is to be 
employed for the interpolation point, is changed over to 



each other in accordance with the results of the judg- 
ment. Interpolated image signal components corre- 
sponding to interpolation points are thereby obtained 
from the interpolating operation processes such that a 
visible image, in which a character pattern and an 
image edge portion are free from any step-like pattern 
and are sharp and a flat portion has an appropriate level 
of sharpness, can be reproduced from the interpolated 
image signal components. 




j SHARPNESS INSTRUCTION 1^*4 
'WPUT MEANS r 



Primed by Rank Xerox (UK) Business Services 
2.14 14.0.4 



EP 0 798 664 A2 

Description 



BACKGROUND OF THE INVENTION 



5 Field of the Invention 

This invention relates to an interpolating operation method and apparatus for an image signal. 
Description of the Prior Art 
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Techniques for photoelectrically reading out a radiation image, which has been recorded on a photographic film, in 
order to obtain an image signal, carrying out appropriate image processing on the image signal, and then reproducing 
a visible image by use of the processed image signal have heretofore been known in various fields. 

Also, it has been proposed to use stimulable phosphors in radiation image recording and reproducing systems. 
Specifically, a radiation image of an object, such as a human body, is recorded on a sheet provided with a layer of the 
stimulable phosphor (hereinafter referred to as a stimulable phosphor sheet). The stimulable phosphor sheet, on which 
the radiation image has been stored, is then exposed to stimulating rays, such as a laser beam, which cause it to emit 
light in proportion to the amount of energy stored thereon during its exposure to the radiation. The light emitted by the 
stimulable phosphor sheet, upon stimulation thereof, is photoelectrically detected and converted into an electric image 
signal. The image signal is then processed and used for the reproduction of the radiation image of the object as a visible 
image on a recording material, such as photographic material, or on a.display device, such as a cathode ray tube (CRT) 
display device. Radiation image recording and reproducing systems, which use stimulable phosphor sheets, are advan- 
tageous over conventional radiography using silver halide photographic materials, in that images can be recorded even 
when the energy intensity of the radiation, to which the stimulable phosphor sheet is exposed, varies over a wide range 
In image recording and reproducing systems, in which an image signal is obtained in the manner described above 
and a visible is reproduced from the image signal, in cases where the region of interest in the visible image is to be 
viewed in more detail, the region of interest is often enlarged and reproduced. In such cases, in order for the enlarged 
image to be obtained, a predetermined interpolating operation may be carried out on the original image signal which 
has been obtained by reading out an original image and is made up of a series of image signal components represent- 
ing _sampl.ng points in the original image, and an interpolation image signal, which is a secondary image signal and is 
made up of a number of image signal components different from that of the original image signal, may thereby be 
formed. A visible image may then be reproduced from the interpolation image signal. In such cases, depending upon 
potn™ 96 8,26 enlaf9ement SCate factor - rt often occurs several interpolation points overlap upon the sampling 

Ordinarily, as an aid in facilitating the constitution of image input and output devices, the sampling points (i e pic- 
ture elements of the original image), which are represented by the image signal components of the original image sig- 
nal, are arrayed at predetermined intervals along horizontal and vertical directions in a square lattice-like form and an 
•mage is thereby formed. In such cases, as the interpolating operation in the image size enlargement processing a lin- 
ear interpolating operation is carried out on the original image signal components representing tour sampling points 
ocated in the vicinity of an interpolation point, which is to be newly set from the interpolating operation, and an interpo- 
lated image signal component corresponding to the interpolation point is thereby obtained 

-^- R>r ^P' 6 ' as illusfr ated in Figure 5A. picture elements S. S. ... of an original image, which are indicated by the 
(J mark, may be arrayed in a square lattice-like form. Interpolated image signal components corresponding to inter- 
potation points S\ S' ... which are indicated by the 'X" mark and are arrayed at intervals different from the intervals of 
45 the picture elements S. S may then be obtained. In such cases, for example, the interpolated image signal compo- 
nent corresponding to an interpolation point So is obtained in the manner described below. 

In the calculation of the interpolated image signal component corresponding to the interpolation point SV, image 
!Ik>? ^^f" 18 S a- s b. Sc. and S D representing four picture elements S A . S B . S c . and S D of the original' image, 
which picture elements are located in the vicinity of the interpolation point S* 0 so as to surround it (and which constitute 
he unit lattice constituting the square lattice), are used. (As an aid in facilitating the explanation, the same symbol as 
that of a pictore element is used tor the image signal component representing the picture element.) This means that a 
square mask of the unit lattice containing the interpolation point is set. and the image signal components representing 
the sampling points, which are located in the square mask are used. 

The pitch between the picture elements S A and S B . the pitch between the picture elements Sc and Sn. the pitch 
between the picture elements S A and Sc. and the pitch between the picture elements S B and S D are respectively taken 
as being equal to 1 Also, as illustrated in Figure 5B. the distance between the picture element S A (or S c ) and the inter- 
pdatton point S 0 . the distance being taken along the x axis direction (i.e.. the horizontal direction), is represented by 
Tx. The distance between the picture element S A (or S B ) and the interpolation point So. the distance being taken along 
they axis direction (i.e.. the vertical direction), is represented by Ty. In such cases, interpolated image signal compo- 
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nents Sm and Sn, which respectively correspond to interpolation points Sm and Sn, that correspond to the positions of 
the interpolation point S* 0 taken respectively from the picture elements S A and Sc along the x axis direction, are calcu- 
lated with linear interpolating operations represented by Formulas (28) and (29) shown below. 

5 ^ Sm=(1-Tx)S A +TxS B (28) 

Sn=(1-Tx)S c +TxS D (29) 

Thereafter, a linear interpolating operation is carried out for the interpolation point S 0 and with respect to the y axis 
io direction by using the interpolated image signal components Sm and Sn, and an interpolated image signal component 
S' 0 is thereby calculated. The linear interpolating operation is represented by Formula (30) shown below. 

S"o=(1-Ty)Sm+TySn (30) 

is The same operations as those described above are also carried out for the other interpolation points S\ S' and 

the corresponding interpolated image signal components S\ S', ... can thereby be obtained. 

The interpolation method described above is not limited to the use in cases where the image size is to be enlarged, 
and can be applied when the image size enlargement or reduction is not carried out. The interpolation method 
described above can also be applied when details of the image are to be reproduced appropriately, e.g.. when a high- 

20 resolution image is to be reproduced. 

Also, the sampling points, from which the interpolated image signal component is to be calculated, are not limited 
to the four sampling points located in the vicinity of the interpolation point. For example, sampling points located in a 
square mask, which comprises 4x4 sampling points and contains the four sampling points located in the vicinity of the 
interpolation point, may be utilized. 

25 For example, as in a radiation image containing bone patterns, a reproduced visible image ordinarily contains an 
image edge portion, at which the image density (or the luminance) changes sharply. It often occurs that the image edge 
portion is enlarged. 

However, in cases where the picture elements of the original image are arrayed in the form of the square lattice (the 
unit lattice), it often occurs that the image edge portion extends in an oblique direction with respect to the square lattice. 

30 Also, in cases where the picture elements of the original image are arrayed in the form of a rhombic lattice, it often 
occurs that the image edge portion extends in the horizontal or vertical direction with respect to the rhombic lattice. In 
such cases, if the interpolating operations are carried out in accordance with Formulas (28), (29), and (30) shown 
above, step-like patterns will become perceptible at the enlarged image edge portion, which extends in the oblique 
direction with respect to the square lattice or in the horizontal or vertical direction with respect to the rhombic lattice. 

35 For example, as illustrated in Figure 7A, an image edge portion may extend in an oblique direction in an image. 
Microscopically, as illustrated in Figure 7B, the boundary line (the image edge portion) between the region, in which 
points having a high image density (indicated by black dots) are located, and the region, in which points having a low 
image density (indicated by white dots) are located, may extend in the oblique direction in the image. In cases where 
an interpolated image signal component S' 0 is calculated by applying the aforesaid interpolating operation to the image 

40 edge portion, the interpolated image signal component S' 0 depends also upon an original image signal component Sp 
representing the low image density. Therefore, as illustrated in Figure 8B, an image signal component representing an 
intermediate image density slightly lower than the image density of the high-density picture elements S A , S B , and S c is 
obtained as the interpolated image signal component S' 0 . As a result, when the enlarged image is reproduced in 
accordance with the obtained interpolated image signal component S* 0 , the enlarged image is obtained in which the 

45 step-like pattern at the image edge portion has been enlarged as indicated by the broken line in Figure 8B. Specifically, 
when the image size enlargement processing is carried out on the image edge portion, which extends in the oblique 
direction as shown in Figure 7A, the step-like pattern at the image edge portion is enlarged as illustrated in Figure 8A. 

The enlarged step-like pattern at the image edge portion adversely affects the image quality in the region in the 
vicinity of the image edge portion. Therefore, there is the risk that an image capable of serving as an effective tool in, 

so particularly, the efficient and accurate diagnosis of an illness, cannot be obtained. 

The problems described above occur not only with an image, in which the sampling points are arrayed along hori- 
zontal and vertical directions in the square lattice-like form, but also with an image, in which an image edge portion 
extends in an oblique direction with respect to the array directions of the sampling points in a unit lattice, such as an 
image, in which the sampling points are arrayed along oblique directions in the form of a rhombic lattice and an image 

55 edge portion extends along the horizontal or vertical direction. 

The problems described above occur when the interpolated image signal component corresponding to the interpo- 
lation point So is calculated by using only the original image signal components S A > S B , S c . and S D representing the 
picture elements S A , S B . S c , and S D of the original image (four sampling points located in the vicinity of the interpolation 
point), which picture elements constitute the unit lattice containing the interpolation point The same problems occur 
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ordinarily when an interpolated image signal component corresponding to an interpolation point is calculated by using 
the image signal components representing the picture elements, which are located in a square mask containing the 
interpolation point 

As for image portions other than the image edge portion, i.e. as for a flat image density portion, at which the change 
in the image density is unsharp, and a portion inward from and surrounded by the image edge portion (these image por- 
tions will hereinbelow be referred to simply as the flat portion), it is desired that the sharpness of the flat portion in the 
reproduced visible image can be adjusted freely by the person, who views the image, such that a reproduced image 
having good image quality can be obtained. 

SUMMARY OF THE INVENTION 

The primary object of the present invention is to provide an interpolating operation method for an image signal, 
wherein interpolated image signal components corresponding to interpolation points, which are located at an image 
edge portion, and interpolation points, which are located at a flat portion, are obtained such that a visible image having 
good image quality can be reproduced from the interpolated image signal components and used as an effective tool in, 
particularly, the accurate and efficient diagnosis of an illness, i.e. such that a visible image, in which a character pattern 
and an image edge portion are free from any step-like pattern and are sharp and a flat portion has an appropriate level 
of sharpness, can be reproduced from the interpolated image signal components. 

Another object of the present invention is to provide an apparatus for carrying out the interpolating operation 
method for an image signal. 

An interpolating operation method for an image signal in accordance with the present invention is characterized by 
changing the interpolating operation process, depending upon whether an interpolation point is located at an image 
edge portion or at a flat image density portion, such that an interpolating operation process capable of obtaining a sharp 
image free from any step-like pattern may be applied with respect to the image edge portion, and such that an interpo- 
lating operation process capable of obtaining a smooth image or an interpolating operation process enabling sharpness 
to be adjusted may be applied with respect to the flat portion. 

Specifically, the present invention provides an interpolating operation method for an image signal, wherein an inter- 
polated image signal component corresponding to an interpolation point is calculated from original image signal com- 
ponents of an original image signal representing an original image, which represent a plurality of sampling points 
arrayed at predetermined intervals and in a lattice-like form, the method comprising the steps of: 

i) making a judgment as to whether the interpolation point belongs to an image edge portion, at which the change 
in the original image signal is sharp, or belongs to a flat portion, at which the change in the original image signal is 
unsharp, and 

ii) changing interpolating operation processes, one of which is to be employed for the interpolation point over to 
each other in accordance with the results of the judgment. 

In the interpolating operation mefthod for an image signal in accordance with the present invention, the sampling 
points arrayed at predetermined intervals and in a lattice-like form. For example, the sampling points may be arrayed 
along horizontal and vertical directions and in a square lattice-like form or a rectangular lattice-like form. Alternatively, 
the sampling points may be arrayed along oblique directions and in a rhombic lattice-like form. Also, the lattice intervals 
may be kept the same for the two array directions or may be varied for the two array directions. 

The judgment as to whether the interpolation point belongs to the image edge portion or the fiat portion can be 
made by, for example, comparing the values of the original image signal components representing four sampling points, 
which constitute the unit lattice containing the interpolation point with one another. 

By way of example, as the interpolating operation process, which is enrployed in cases where, as a result of the 
judgment, it has been judged that the interpolation point belongs to the image edge portion, the interpolating operation 
process described in (1) or (2) below may be employed. 

(1) An interpolating operation process comprising the steps of: 

a) specifying the direction, along which the image edge portion extends, with respect to the array directions of 
the sampling points in a unit lattice, and 

b) changing selection processes for selecting the original image signal components, from which the interpo- 
lated image signal component corresponding to the interpolation point is to be calculated, over to each other 
in accordance with the direction, along which the image edge portion extends. 

(2) An interpolating operation process comprising the steps of: 
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a) calculating each of interpolation coefficients, by which the corresponding one of the original image signal 
components is to be multiplied, from the original image signal components, which represent a plurality of the 
sampling points located in the vicinity of the interpolation point. 

b) calculating an image density gradient vector at the interpolation point on the original image, which is repre- 
5 sented by the original image signal components, 

c) calculating the distance between a line segment, which intersects perpendicularly to the image density gra- 
dient vector, and each of the sampling points located in the vicinity of the interpolation point, 

d) correcting the interpolation coefficients such that the interpolation coefficient, by which the corresponding 
original image signal component is to be multiplied, may become small for a sampling point, for which the 

10 image density gradient vector and/or the distance is comparatively large, and 

e) multiplying the original image signal component by the corresponding corrected interpolation coefficient. 

In cases where the interpolating operation process described in (1 ) above is employed, the direction, along which 
the image edge portion extends, maybe specified by, for example: 

15 

(a) grouping each of two sets of sampling points, each set being constituted of two sampling points, which are 
located at two diagonal positions facing each other in the unit lattice, that contains the interpolation point therein, 

calculating the difference between the original image signal components representing the two sampling 
points, which constitute each of the two sets of sampling points, and 
20 comparing the differences, which have been calculated for the two sets of sampling points, with each other; 

or 

(b) grouping each of two sets of sampling points, each set being constituted of two sampling points, which are 
located at two diagonal positions facing each other in the unit lattice, that contains the interpolation point therein, 

calculating the difference between the original image signal components representing the two sampling 
25 points, which constitute each of the two sets of sampling points, 

comparing the differences, which have been calculated for the two sets of sampling points, with each other, 

and 

carrying out an operation in accordance with the original image signal components representing the sam- 
pling points, which are located around the unit lattice, that contains the interpolation point therein; or 
30 (c) calculating an image density gradient vector with respect to each of the two array directions of the sampling 
points in the unit lattice, the calculation being made from the original image signal components representing four 
sampling points, which constitute the unit lattice, that contains the interpolation point therein, and 

making a judgment from the magnitude and the product of the two image density gradient vectors, which 
have been calculated with respect to the two array directions of the sampling points in the unit lattice. 

35 

Also, in cases where the interpolating operation process described in (1) above is employed, the selection proc- 
esses for selecting the original image signal components to be used in the calculation of the interpolated image signal 
component, the selection processes being changed over to each other in accordance with the direction, along which 
the image edge portion extends, may comprise, for example: 

40 

(i) a selection process, which is employed in cases where it has been specified that the image edge portion extends 
along an oblique direction with respect to the array directions of the sampling points in the unit lattice, the selection 
process comprising the steps of: 

45 dividing the unit lattice into two triangular regions with the image edge portion serving as the boundary there- 

between, 

selecting a triangular region, which contains the interpolation point therein, from the two triangular regions, and 
selecting the original image signal components, which represent the three sampling points, that constitute the 
triangular region containing the interpolation point therein, and 

so 

(ii) a selection process, which is employed in cases where it has been specified that the image edge portion 
extends along a direction parallel to one of the array directions of the sampling points in the unit lattice, the selection 
process comprising selecting the original image signal components, which represent the four sampling points, that 
constitute the unit lattice containing the interpolation point therein. 

55 

In cases where the interpolated image signal component corresponding to the interpolation point is calculated from 
the original image signal components representing the three sampling points, the interpolating operation may be car- 
ried out with one of various functions, such as a linear function, a second order function, and a higher order function. 

The interpolating operation process, which is employed in cases where, as a result of the judgment, it has been 



5 



10 



15 



20 



EP 0 798 664 A2 

judged that the interpolation point belongs to the flat portion, may be an interpolating operation process, with which the 
sharpness of the flat portion is rendered variable. By way of example, the interpolating operation process, with which 
the sharpness of the flat portion is rendered variable, may be: 

(I) a spline interpolating operation process, pr 

(II) an interpolating operation process, comprising the steps of: 

linearly combining interpolation coefficients Bij and Cij, which correspond to each other and are set for each of 
the original image signal components Yij, in two different interpolating functions f and g (for example, a cubic 
spline interpolating operation function and a B spline interpolating operation function) for obtaining two inter- 
polation images having different levels of sharpness, which functions are represented by Formulas (24) and 
(25), the linear combination being carried out with Formula (26) by use of a variable factor a, where a is set to 
be one of all real numbers, a new interpolation coefficient Aij being obtained from the linear combination, and 
carrying out an interpolating operation on the original image signal components Yij by using an interpolating 
function h having the new interpolation coefficient Aij, which function is represented by Formula (27): 

f=!Bij-Yij (24) 

g=XCij • Yij (25) 

Aij=(1-a)Bij+aCij (26) 

h=XAij-Yij (27) 

25 in which i=1, 2, ... ,j=1. 2, .... and 

a represents one of all real numbers. 

In cases where it has been judged that the interpolation point belongs to the flat portion, and the interpolating oper- 
ation process, with which the sharpness of the flat portion is rendered variable, is employed, the interpolating operation 
process defined above for the image edge portion need not necessarily be carried out. Specifically, in cases where the 
interpolating operation process, with which the sharpness of the flat portion is rendered variable, is at least employed 
when it has been judged that the interpolation point belongs to the flat portion, any of conventional interpolating opera- 
tion processes may be utilized as the interpolating operation process for the image edge portion. 

As the spline interpolating operation process described in (I) above, by way of example, one of the interpolating 
operation processes described in (A), (B), and (C) below may be employed. 

(A) The spline interpolating operation process is an interpolating operation process for obtaining an interpolated 
image signal component with Formula ( 1 ), 

Y P = a k-i Y k-i +a k Y k +a k+i Y k+i « k + 2 Y k+2 (1 ) 

in which Y k . 1( Y k , Y k+1 . and Y k+2 represent the original image signal components representing samp ling poi nts 
serving as picture elements , X k , , and Xk +2 in the original image, Y p represents the interpolated image sig- 
nal component corresponding to an interpolation point Xp located between the picture elements X k and X k+1 , and 
Sk-v a k , a k ^ t and a k+2 represent the interpolation coefficients, 
the process comprising the steps of: 

a) calculating the interpolation coefficients a k . 1t a*. a^,, and a k+2 respectively corresponding to the original 
image signal components Y k ^ . Y k . Y k+1 , and Y k+2 such that, in cases where the original image signal compo- 
nents representing the two picture elements X^ and located before the interpolation point Xp. which is 
located between the picture elements X* and x^ +1 in the original image, are represented by Y k ., and Y k , the 
original image signal components representing the two picture elements X^ and X k+2 located after the inter- 
polation point Xp are represented by Y k+1 and Y k+2 , a third-order spline interpolating function between the pic- 
ture elements Xk and X k+1 is represented by f k . a third-order spline interpolating function between the picture 
elements X^ and X k is represented by f M . and a third-order spline interpolating function between the picture 
elements X k4-1 and Xk +2 is represented by f k+1 : 

® the spline interpolating function f k at the picture elements X k and X k ^ may satisfy the original image 
signal components Y k and Y k+1 , as represented by Formulas (2) and (3): 
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MX k )=Y k (2) 
f K (X^i)=Y k+1 (3) 

@ the first-order differential coefficient of the spline interpolating function f k at the picture element X k may 
coincide with the first-order differential coefficient of the spline interpolating function f k .-j at the picture ele- 
ment X k , as represented by Formula (4): 

<K'(X h )=f k . 1 '(X k ) (4) 

® the first-order differential coefficient of the spline interpolating function f k at the picture element X|< +1 
may coincide with the first-order differential coefficient of the spline interpolating function f k+1 at the picture 
element X k+1 , as represented by Formula (5): 

75 fK'(X k+1 )=f k+ V(X k+1 ) (5) 

@ the first-order differential coefficient of the spline interpolating function f k at the picture element X k may 
have an inclination of an arbitrary parameter a with respect to the gradient of the original image signal 
components Y k . n and Y k+1 representing the picture elements X k .-, and X k+V which are located before and 
20 after the picture element X k , as represented by Formula (6), the arbitrary parameter a being selected pre- 

viously and determining the sharpness of a secondary image represented by the interpolation image sig- 
nal obtained from the interpolating operation, 



f k(X k )=*(Y k+ i -Y k-i >'(X m -X ^ ) ( 6 ) 



25 



and 

<§) the first-order differential coefficient of the spline interpolating function f k at the picture element X k +-, 
may have an inclination of the parameter a with respect to the gradient of the original image signal com- 
ponents Y k and Y k+2 representing the picture elements X k and X^, which are located before and after the 
30 picture element X k+1 . as represented by Formula (7): 

* k*(X k+1 )=a(Y k+2 -Y k )/(X k+2 -X k ) (7) 

and 

35 

b) calculating the interpolated image signal component Y p corresponding to the interpolation point X p in 
accordance with the calculated interpolation coefficients a k . 1f a^ a^-j, and a k+2 , and the original image signal 
components Y M , Y k . Y k+1 , and Y k+2 . 

40 (B) The spline interpolating operation process is an interpolating operation process for obtaining an interpolated 
image signal component with Formula (1), 

Y p =a k . n Y k-1 +a k Y k +a k+1 Y k+1 +a k + 2 Y k + 2 (1 ) 

45 in which Y k . 1( Y k , Y k+1 , and Y k+2 represent the original image signal components representing sampling points 
serving as picture elements X k .<, , X k> X k+1l and X k+2 in the original image, Y p represents the interpolated image sig- 
nal component corresponding to an interpolation point Xp located between the picture elements Xj< and X k+1 , and 
Sk+i. ^k. a k +i. and a^ represent the interpolation coefficients, 
the process comprising the steps of: 

so 

a) calculating the interpolation coefficients a^. a k , a k+1 , and a^ respectively corresponding to the original 
image signal components Y k . 1t Y k , Y k+1 , and Y k+2 such that, in cases where the original image signal compo- 
nents representing the two picture elements X k _ n and X k located before the interpolation point X p , which is 
located between the picture elements X k and X k+1 in the original image, are represented by Y M and Y k . the 
55 original image signal components representing the two picture elements X k+1 and X k+2 located after the inter- 

polation point Xp are represented by Y k+1 and Y k+2 , a third-order spline interpolating function between the pic- 
ture elements X k and X k+1 is represented by f k , a third-order spline interpolating function between the picture 
elements X^ and X k is represented by f k . 1t and a third-order spline interpolating function between the picture 
elements Xk +1 and X^ is represented by f k+1 : 
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® the spline interpolating function f k at the picture elements \ and X k+1 may slightly deviate from the 
original image signal components Y k and Y k+1 in accordance with an arbitrary parameter p, as repre- 
sented by Formulas (12) and (13). the arbitrary parameter p being selected previously and determining the 
sharpness of a secondary image represented by the interpolation image signal obtained from the interpo- 
lating operation, 

f k (X k )=-0.5pY M +0+MY K-0.5PY k+1 * (12 ) 

* k(X k+ i )=^0.5p Y k+ (1 + P)Y M -O.SpY k+2 (13) 

© the first-order differential coefficient of the spline interpolating function f k at the picture element X k may 
coincide with the first-order differential coefficient of the spline interpolating function f ko at the picture ele- 
ment X k , as represented by Formula (4): 

V(*K>=W(X k ) (4) 

® the first-order differential coefficient of the spline interpolating function f k at the picture element X k+1 
may coincide with the first-order differential coefficient of the spline interpolating function f k+1 at the picture 
element X k+1 , as represented by Formula (5): 

f k'(X K+n )=f k+1 , (X k+1 ) (5) 

® the first-order differential coefficient of the spline interpolating function f k at the picture element X k may 
coincide with the gradient of the original image signal components Y^ and Y k+1 representing the picture 
elements X k . n and X k+1 , which are located before and after the picture element X k . as represented by For- 
mula (14): 

^V fc HY^Y M KX w -X M ) (14) 

and 

© the first-order differential coefficient of the spline interpolating function f k at the picture element X k+1 
may coincide with the gradient of the original image signal components Y k and Y k+2 representing the pic- 
ture elements X k and X^. which are located before and after the picture element X k+1 , as represented by 
Formula (15): 

fK'(X k+1 )=(Y k+2 -Y k )/(X k+2 -X k ) (15 ) 

and 

b) calculating the interpolated image signal component Y p corresponding to the interpolation point Xp in 
accordance with the calculated interpolation coefficients a k . v a k , a k+1 . and a k+2 , and the original image signal 
components Y k . 1( Y k , Y k+1 . and Y k+2 . 

(C) The spline interpolating operation process is an interpolating operation process for obtaining an interpolated 
image signal component with Formula (1), 

Y P = a k-1 Y k-1 +a k Y k+a k + i Y k + i +a k + 2 Y k + 2 (1 ) 

in which Y k . 1( Y k , Y k+1 , and Y k+2 represent the original image signal components representing sampling points 
serving as picture elements X k . 1 , X k . . and X k+2 in the original image. Y p represents the interpolated image sig- 
nal component corresponding to an interpolation point Xp located between the picture elements Xk. and X k+1 . an a*. 
1. 3k. a k+i. and a k+2 represent the interpolation coefficients, 
the process comprising the steps of: 

a) calculating the interpolation coefficients a k . 1( a*, a^, and a*^ respectively corresponding to the original 
image signal components Y k _ 1( Y k . Y k+1 , and Y k+2 such that, in cases where the original image signal compo- 
nents representing the two picture elements and X k located before the interpolation point Xp, which is 
located between the picture elements X k and X k+1 in the original image, are represented by Y^ and Y k . the 
original image signal components representing the two picture elements Xk + i and \ +2 located after the inter- 
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potation point X p are represented by Y k+1 and Y k+2 , a third-order spline interpolating function between the pic- 
ture elements X k and X k+1 is represented by f k , a third-order spline interpolating function between the picture 
elements and X k is represented by f k _ 1t and a third-order spline interpolating function between the picture 
elements X k+1 and X k+2 is represented by f k+1 : 

*. 

© the spline interpolating function f k at the picture elements X k and X k+1 may satisfy the original image 
signal components Y k and Y k+1 , as represented by Formulas (2) and (3): 

fk(X k >=Y K (2) 

fk(X k+ i)=Y k+1 (3) 

© the first-order differential coefficient of the spline interpolating function f k at the picture element X k may 
coincide with the first-order differential coefficient of the spline interpolating function f k _ n at the picture ele- 
ment Xk, as represented by Formula (4): 

VP^Mk-iXXk) (4) 

® the first-order differential coefficient of the spline interpolating function f k at the picture element X k+1 
may coincide with the first-order differential coefficient of the spline interpolating function f k+1 at the picture 
element X k+1 , as represented by Formula (5): 

f k(X k+1 )=f K+l XX k+1 ) (5) 

© the first-order differential coefficient of the spline interpolating function f k at the picture element X k may 
have an inclination of an arbitrary parameter a with respect to the gradient of the original image signal 
components Y k .., and Y k+1 representing the picture elements X^., and Xk +1 . which are located before and 
after the picture element X k , as represented by Formula (6). the arbitrary parameter a being selected pre- 
viously and determining the sharpness of a secondary image represented by the interpolation image sig- 
nal obtained from the interpolating operation, 

f k -(X k )-a(Y M .Y M V(X fer X M ) (6) 

and 

© the first-order differential coefficient of the spline interpolating function f k at the picture element X k+1 
may have an inclination of the parameter a with respect to the gradient of the original image signal com- 
ponents Y k and Y k+2 representing the picture elements X k and X k+2 , which are located before and after the 
picture element X k+1 , as represented by Formula (7): 

* k'(X k+1 )=a(Y k+2 -Y k )/(X k+2 -X k ) (7) 

b) calculating interpolation coefficients b^, fc^, fcv^, and bk +2 respectively corresponding to the original image 
signal components Y k . 1( Y k , Y k+1 , and Y k+2 such that: 

© the spline interpolating function f k at the picture elements X k and X K+1 may slightly deviate from the 
original image signal components Y k and Y k+1 in accordance with an arbitrary parameter p, as repre- 
sented by Formulas (12) and (1 3), the arbitrary parameter p being selected previously and determining the 
sharpness of the secondary image represented by the interpolation image signal obtained from the inter- 
polating operation, 

f k (X k )=-05pY K . l+ (1 + P)Y k -0.5pY k+1 (12) 

f k(* k+1 )-0.5pY k+ (1 +P)Y k+1 -0.5PY k+2 (13) 

@ the first-order differential coefficient of the spline interpolating function f k at the picture element X k may 
coincide with the first-order differential coefficient of the spline interpolating function f k .<, at the picture ele- 
ment X k , as represented by Formula (4): 



V(X k H k -i'(X k ) 
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® the first-order differential coefficient of the spline interpolating function f k at the picture element X k+1 
may coincide with the first-order differential coefficient of the spline interpolating function f k+1 at the picture 
element X^, as represented by Formula (5): 

M X k + i)=W(><k + i) (5) 

® the first-order differential coefficient of the spline interpolating function f k at the picture element Xj< may 
coincide with the gradient of the original image signal components Y k . 1 and Y k+1 representing the picture 
elements X^., and X k+1 , which are located before and after the picture element X k , as represented by For- 
mula (14): 

UXX^Y^-Y^WX^-X,.,) (14) 

and 

©the first-order differential coefficient of the spline interpolating function f k at the picture element X k+1 
may coincide with the gradient of the original image signal components Y k and Y k+2 representing the pic- 
ture elements X k and X k+2 . which are located before and after the picture element X k+1 , as represented by 
Formula (15): 

* k'(X k+1 )=(Y k+2 -Y k )/(X k+2 -X k ) (15) 

c) calculating a mean value of the set of the interpolation coefficients a^ and b^, a mean value of the set of 
the interpolation coefficients a k and b^ a mean value of the set of the interpolation coefficients a^, and b^, 
and a mean value of the set of the interpolation coefficients a k+2 and b k+2 . which sets respectively correspond 
to the original image signal components Y k _ 1t Y k , Y ki . 1f and Y k+2 . the calculated mean values being taken as 
the values of new interpolation coefficients a^. a^ a^-,, and a^s, and 

d) calculating the interpolated image signal component Y p corresponding to the interpolation point Xp in 
accordance with the calculated new interpolation coefficients a^, a^ a^. and a k+2 . and the original image 
signal components Y k .., , Y k . Y k+1 , and Y k+2 . 

In the interpolating operation process described in (A) above, the calculated interpolation coefficients a M , a^ a^, 
and a k+2 may be respectively represented by Formulas (8). (9). (10), and (1 1): 

a k ,=-(o^)t(M) 2 (8) 

a k =(2-a/2)t 3 -(3-a/2)t 2 +1 (9) 

a k+1 =(a^-2)t 3 +(3.a)t 2 +(a/2)t (10) 

a k+2 =(a/2)t 2 (t-1) (11) 

in which t, where 0<st<1 , represents the position of the interpolation point Xp p the position being taken with respect to the 
picture element X k> that serves as a reference position, and in the direction heading toward the picture element X k+1 , 
the lattice interval of the original image signal components being set to be equal to 1. 

In the interpolating operation process described in (B) above, the calculated interpolation coefficients a M , a^ a^ , 
and an +2 may be respectively represented by Formulas (16). (17), (18). and (19): 



a k -iMP+1/2)t^-(3p/2+1)t 2 -(1/2)t-p/2 (i 6 ) 

a k =3(p+1/2)t 3 -(9p/2+5y2)t 2 +p+1 (17) 

a k+1 =-3(p+1/2)t 3 +(9p/2+2)t 2 +(1/2)t-(5/2 (18) 

a k+2 =(P+1/2)t 3 -(3p/2+1/2)t 2 (19) 



in which t, where 0<a<1 , represents the position of the interpolation point Xp, the position being taken with respect to the 
picture element X k , that serves as a reference position, and in the direction heading toward the picture element X k+1 , 
the lattice interval of the original image signal components being set to be equal to 1 . 

In the interpolating operation process described in (C) above, the calculated new interpolation coefficients a k . 1t a k . 
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ak +1 , and a k+2 . which represent the mean values, may be respectively represented by Formulas (20), (21), (22), and 
(23): 



in which t, where 0st<1 1 represents the position of the interpolation point X p , the position being taken with respect to the 
picture element X k , that serves as a reference position, and in the direction heading toward the picture element X^, 
the lattice interval of the original image signal components being set to be equal to 1 . 

The present invention also provides an apparatus for carrying out the interpolating operation method for an image 
signal in accordance with the present invention. Specifically, the present invention also provides an interpolating oper- 
ation apparatus for an image signal, wherein an interpolated image signal component corresponding to an interpolation 
point is calculated from original image signal components of an original image signal representing an original image, 
which represent a plurality of sampling points arrayed at predetermined intervals and in a lattice-like form, the apparatus 
comprising: 

i) an edge presence or absence judging means for making a judgment as to whether the interpolation point belongs 
to an image edge portion, at which the change in the original image signal is sharp, or belongs to aflat portion, at 
which the change in the original image signal is unsharp, 

ii) a first interpolating operation means for calculating an interpolated image signal component corresponding to an 
interpolation point which belongs to the image edge portion, 

iii) a second interpolating operation means for* calculating an interpolated image signal component corresponding 
to an interpolation point, which belongs to the flat portion, and 

iv) an operation change-over means for changing the first interpolating operation means and the second interpolat- 
ing operation means over to each other, such that the first interpolating operation means may be utilized in cases 
where, as a result of the judgment made by the edge presence or absence judging means, it has been judged that 
the interpolation point belongs to the image edge portion, and such that the second interpolating operation means 
may be utilized in cases where, as a result of the judgment made by the edge presence or absence judging means, 
it has been judged that the interpolation point belongs to the flat portion. 

By way of example, as the first interpolating operation means, the first interpolating operation means described in 
(1) or (2) below may be employed. 

(1 ) A first interpolating operation means comprising: 

a) an edge extending direction specifying means for specifying the direction, along which the image edge por- 
tion extends, with respect to the array directions of the sampling points in a unit lattice, 

b) a first operation means comprising: 

a region dividing means for dividing the unit lattice into two triangular regions with the image edge portion 
serving as the boundary therebetween, the image edge portion extending along an oblique direction with 
respect to the array directions of the sampling points in the unit lattice, 

a region selecting means for selecting a triangular region, which contains the interpolation point therein, 
from the two triangular regions, and 

an operation means for calculating the interpolated image signal component corresponding to the interpo- 
lation point, the calculation being made from the original image signal components, which represent the 
three sampling points, that constitute the triangular region containing the interpolation point therein. 

c) a second operation means for calculating the interpolated image signal component corresponding to the 
interpolation point, the calculation being made from the original image signal components, which represent the 
four sampling points, that constitute the unit lattice containing the interpolation point therein, and 

d) an operation selecting means for: 



a ^ =-{(a+2p+1 )/4}t 3 +{(2a+3p+2)/4}t 2 -{(a+1)/4}t-p/4 

a k H(-a+6p+7)/4}t 3 +{(a-9p-11)/4}t 2 +p/2+1 
a k+1 ={(a-6p-7)/4}t 3 +{(-2a+9p+10)/4)t 2 +{(a+1)/4}t-p/4 
aK + 2=«a+2P+1)/4}t 3 -{(a+3p+1)/4}t 2 



(20) 



(21) 



(22) 



(23) 



selecting the first operation means in cases where, as a result of the specifying carried out by the edge 
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extending direction specifying means, it has been specified that the image edge portion extends along an 
oblique direction with respect to the array directions of the sampling points in the unit lattice, and 
selecting the second operation means in cases where, as a result of the specifying carried out by the edge 
extending direction specifying means, it has been specified that the image edge portion extends along a 
direction parallel to one of the array directions of the sampling points in the unit lattice. 

(2) A first interpolating operation means comprising: 

a) an interpolation coefficient calculating means for calculating each of interpolation coefficients, by which the 
corresponding one of the original image signal components is to be multiplied, from the original image signal 
components, which represent a plurality of the sampling points located in the vicinity of the interpolation point, 

b) an image density gradient vector calculating means for calculating an image density gradient vector at the 
interpolation point on the original image, which is represented by the original image signal components, 

c) a distance calculating means for calculating the distance between a line segment which intersects perpen- 
dicularly to the image density gradient vector, and each of the sampling points located in the vicinity of the inter- 
polation point, 

d) a correction means for correcting the interpolation coefficients such that the interpolation coefficient, by 
which the corresponding original image signal component is to be multiplied, may become small for a sampling 
point, for which the image density gradient vector and/or the distance is comparatively large, and 

e) an operation processing means for multiplying the original image signal component by the corresponding 
interpolation coefficient, which has been corrected by the correction means. 

in cases where the first interpolating operation means described in (1 ) above is employed, the edge extending 
direction specifying means may specify the direction, along which the image edge portion extends, by. for example: 

(a) grouping each of two sets of sampling points, each set being constituted of two sampling points, which are 
located at two diagonal positions facing each other in the unit lattice, that contains the interpolation point therein, 

calculating the difference between the original image signal components representing the two sampling 
points, which constitute each of the two sets of sampling points, and 

comparing the differences, which have been calculated for the two sets of sampling points, with each other; 

or 

(b) grouping each of two sets of sampling points, each set being constituted of two sampling points, which are 
located at two diagonal positions facing each other in the unit lattice, that contains the interpolation point therein. 

calculating the difference between the original image signal components representing the two sampling 
points, which constitute each of the two sets of sampling points, 

comparing the differences, which have been calculated for the two sets of sampling points, with each other 

and 

carrying out an operation in accordance with the original image signal components representing the sam- 
pling points, which are located around the unit lattice, that contains the interpolation point therein; or 

(c) calculating an image density gradient vector with respect to each of the two array directions of the sampling 
points in the unit lattice, the calculation being made from the original image signal components representing four 
sampling points, which constitute the unit lattice, that contains the interpolation point therein, and 

making a judgment from the magnitude and the product of the two image density gradient vectors, which 
have been calculated with respect to the two array directions of the sampling points in the unit lattice. 

Regardless of the constitution of the first interpolating operation means, the second interpolating operation means 
may comprise: 

an input means for inputting an instruction concerning the alteration of sharpness of the flat portion from the exte- 
rior, and 

an interpolating operation means, with which the sharpness of the flat portion is capable of being altered in accord- 
ance with the instruction inputted from the input means. 

By way of example, the interpolating operation means, with which the sharpness of the flat portion is capable of 
being altered, may be: 

(I) a spline interpolating operation means, or 

(II) an interpolating operation means for; 
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linearly combining interpolation coefficients Bij and Cij, which correspond to each other and are set for each of 
the original image signal components Yij, in two different interpolating functions f and g (for example, a cubic 
spline interpolating operation function and a B spline interpolating operation function) for obtaining two inter- 
polation images having different levels of sharpness, which functions are represented by Formulas (24) and 
(25). the linear combination being carried out with Formula (26), a new interpolation coefficient Aij being 
obtained from the linear combination, and 

carrying out an interpolating operation on the original image signal components Yij by using an interpolating 
function h having the new interpolation coefficient Aij, which function is represented by Formula (27). an inter- 
polation image signal being obtained from the interpolating operation, the interpolation image signal being 
made up of a series of image signal components, which occur at intervals different from those of the original 
image signal components Yij: 

f=!Bij • Yij (24) 
g=lCij • Yij (25) 
Aij=(1-a)Bij+aCij (26) 
h=EAij • Yij (27) 

in which i=1 , 2 j=1 , 2 and 

a represents one of all real numbers. 

As the spline interpolating operation means described in (I) above, by way of example, one of the interpolating 
operation means described in (A), (B), and (C) below may be employed. 

(A) The spline interpolating operation means is an interpolating operation means for obtaining an interpolated 
image signal component with Formula (1 ). 

Y p =a k-l Y k-1 +a k Y k+3 k+1 Y k+1 +a k+2 Y k+2 ( 1 ) 

in which Y k ^ , Y k , Y k+1 , and Y k+2 represent the original image signal components representing picture elements X k _ 
1- x k. Xk+v ar *d X k+2 in the original image, Y p represents the interpolated image signal component corresponding 
to an interpolation point X p located between the picture elements X* and X k+1 , and a^, a^, and repre- 
sent the interpolation coefficients. 

the spline interpolating operation means comprising: 

1) a storage means for storing information representing the interpolation coefficients a k . 1 , a*, a^, and a^. 
which respectively correspond to the original image signal components Y k . 1( Y k , Y k+1 , and Y k+2 representing 
the picture elements X^, X^ X k+1 , and X k+2 in the original image, and which are set to be respectively repre- 
sented by Formulas (8), (9). (10). and (11): 

a M =-(aV2)t(t-1) 2 (8) 
a k =(2-a/2)t 3 -(3-a/2)t 2 +1 (9) 
a k+1 =(a^-2)t 3 +(3-a)t 2 +(ay2)t (10) 

a k+2 =(a/2)t 2 (t-1) (11) 

in which a represents the parameter determining the sharpness of a secondary image represented by the 
interpolation image signal obtained from the interpolating operation, and t. where 0£t<1. represents the posi- 
tion of the interpolation point Xp, the position being taken with respect to the picture element X k , that serves as 
a reference position, and in the direction heading toward the picture element X k+1 , the lattice interval of the 
original image signal components being set to be equal to 1 , 

2) an input means for inputting the arbitrary parameter a, which determines the sharpness of the secondary 
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image reproduced from the interpolation image signal obtained from the interpolating operation, 

3) an interpolation coefficient operation means for calculating the interpolation coefficients a k . 1t a* a k+1 , and 
aK +2 in accordance with the parameter a, the calculation being carried out from the interpolation coefficients, 
which are stored in the storage means, and the parameter a inputted from the input means, and 

4) an interpolating operation means for storing Formula (1) as the operation formula, and calculating the value 
of the interpolated image signal component Y p , which corresponds to the interpolation point Xp. with Formula 
(1) in accordance with the interpolation coefficients a^. a^ a^, and a^. which have been calculated by the 
interpolation coefficient operation means, and the original image signal components Y k _ v Y k , Y k+1 , and Y k+2 . 

(B) The spline interpolating operation means is an interpolating operation means for obtaining an interpolated 
image signal component with Formula (1), 

Y p =a k-1 Y k-1 + a k Y k* 3 k+1 Y k+1 +a k+2 Y k+2 (1 ) 

in which Y k _ 1( Y k , Y k+1 , and Y k+2 represent the original image signal components representing picture elements 
1. X k , X^, and X k+2 in the original image, Y p represents the interpolated image signal component corresponding 
to an interpolation point Xp located between the picture elements Xk and X^-,. and a*..,, a k , a*^. and repre- 
sent the interpolation coefficients, 

the spline interpolating operation means comprising: 

1) a storage means for storing information representing the interpolation coefficients a^, a k . a^. and a^, 
which respectively correspond to the original image signal components Y k . v Y k , Y k+1 , and Y k ^ 2 representing 
the picture elements X^.,, Xk, X^.,. and X k+2 in the originallmage, and which are set to be respectively repre- 



sented by Formulas (16), (17). (18). and (19): 

a M -(p+1/2)t 3 +(3B/2+1>t 2 -(1/2)t-p/2 (16) 

a k =3(p+1/2)t 3 -(9p/2+5/2)t 2 +p+1 (17) 

a k+1 =-3(p+1/2)t 3 +(9p/2+2)t 2 +(1/2)t-p/2 (18) 

a k ^p+1/2)t 3 -(3p/2+1/2)t 2 (19) 



in which p represents the parameter determining the sharpness of a secondary image represented by the inter- 
polation image signal obtained from the interpolating operation, and t, where 0st<1 , represents the position of 
the interpolation point Xp. the position being taken with respect to the picture element X k , that serves as a ref- 
erence position, and in the direction heading toward the picture element X k+1 , the lattice interval of Ihe original 
image signal components being set to be equal to 1 , 

2) an input means for inputting the arbitrary parameter p, which determines the sharpness of the secondary 
image reproduced from the interpolation image signal obtained from the interpolating operation, 

3) an interpolation coefficient operation means for calculating the interpolation coefficients a^l a k+1 , and 
a^ in accordance with the parameter p, the calculation being carried out from the interpolation coefficients, 
which are stored in the storage means, and the parameter p inputted from the input means, and 

4) an interpolating operation means for storing Formula (1 ) as the operation formula, and calculating the value 
of the interpolated image signal component Y p , which corresponds to the interpolation point Xp, with Formula 
(1) »n accordance with the interpolation coefficients a^, a*, a k+1 , and a k+2 , which have been calculated by the 
interpolation coefficient operation means, and the original image signal components Y k . 1( Y k , Y k+1 , and Y k+2 . 

(C) The spline interpolating operation means is an interpolating operation means for obtaining an interpolated 
image signal component with Formula (1). 



Y p sa k-1 Y k-1 + a k Y k+ 3 k+1 Y K+1 +a k+2 Y k + 2 ( 1 ) 

in which Y k .«, . Y k . Y k+1 , . and Y k+2 represent the original image signal components representing picture elements Xfc. 
1. X k . Xj^l and in the original image. Y p represents the interpolated image signal component corresponding 
to an interpolation point Xp located between the picture elements X* and X k+1 , and ak 1f a k , a^,. and a*., repre- 
sent the interpolation ^efficients. 

the spline interpolating operation means comprising: 
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1) a storage means for storing information representing the interpolation coefficients a k _ 1( a^ a^, and a^. 
which respectively correspond to the original image signal components , Y kl Y k+1 , and Y k+2 representing 
the picture elements X^, X k , X k+1 , and X k+2 in the original image, and which are set to be respectively repre- 
sented by Formulas (20). (21), (22), and (23): 

a M =-[{a+2 p+1)/4}t 3 +{(2a+3 p+2)/4]t 2 -{(a+1 )/4}t-p/4 (20) 

a k ={(-a+6p+7)/4}t 3 +{(a-9p-11)/4}t 2 +p/2+1 (21) 

a k+1 ={(a-6p-7)/4}t 3 +{(-2a+9p+1 0)/4]t 2 +{(a+1)/4}t- p/4 (22) 

a K+2 ={(a+2p+1)/4}t 3 -{(a+3p+1)/4}t 2 (23) 

in which a and p represent the parameters determining the sharpness of a secondary image represented by 
the interpolation image signal obtained from the interpolating operation, and t t where 0st<1 . represents the 
position of the interpolation point Xp, the position being taken with respect to the picture element X kt that serves 
as a reference position, and in the direction heading toward the picture element X k+1 , the lattice interval of the 
original image signal components being set to be equal to 1 , 

2) an input means for inputting the arbitrary parameters a and p, which determine the sharpness of the sec- 
ondary image reproduced from the interpolation image signal obtained from the interpolating operation, 

3) an interpolation coefficient operation means for calculating the interpolation coefficients a^, a k , a k+1 , and 
a k+2 in accordance with the parameters a and p, the calculation being carried out from the interpolation coef- 
ficients, which are stored in the storage means, and the parameters a and p inputted from the input means, and 

4) an interpolating operation means for storing Formula (1) as the operation formula, and calculating the value 
of the interpolated image signal component Y p , which corresponds to the interpolation point Xp, with Formula 
(1) in accordance with the interpolation coefficients a^. a k . a^, and a^. which have been calculated by the 
interpolation coefficient operation means, and the original image signal components Y k ^ , Y k , Y k+1l and Y k+2 . 

The interpolating operation method and apparatus for an image signal in accordance with the present invention 
have the advantages described below over the conventional interpolating operation method and apparatus, wherein the 
same interpolating operation process is employed regardless of whether an interpolation point is located at an image 
edge portion, aflat portion, or the like, in the image. Specifically, the interpolating operation processes, one of which is 
to be employed for the interpolation point, are changed over to each other in accordance with whether the interpolation 
point is located at the image edge portion or the flat portion in the image. The interpolating operation process, which is 
suitable for the image edge portion, is employed for the interpolation point located at the image edge portion. Also, the 
interpolating operation process, which is suitable for the flat portion, is employed for the interpolation point located at 
the flat portion. In this manner, a reproduced visible image, which has good image quality as a whole and can serve as 
an effective tool in, particularly, the accurate and efficient diagnosis of an illness, can be obtained from the interpolation 
image signal, which has been obtained from the interpolating operation. 

For example, in cases where it has been judged that the interpolation point belongs to the image edge portion, the 
direction, along which the image edge portion extends, is discriminated (i.e.. specified). In cases where it has been 
specified that the image edge portion extends along an oblique direction with respect to the array directions of the sam- 
pling points in the unit lattice, the unit lattice is divided into two triangular regions with the image edge portion serving 
as the boundary between them. Also, the triangular region, which contains the interpolation point therein, is selected 
from the two triangular regions. The interpolated image signal component corresponding to the interpolation point is 
calculated from the original image signal components, which represent the three lattice points (i.e.. the three sampling 
points), that constitute the triangular region containing the interpolation point therein. Therefore, the interpolated image 
signal component corresponding to the interpolation point, which is located at the oblique image edge portion, does not 
depend upon the original image signal components, which represent the picture elements having markedly different 
image density values (or luminance values or other kinds of signal values). Accordingly, the problems can be prevented 
from occurring in that an interpolated point having an intermediate level of image density occurs in a high image density 
region or a low image density region. 

In cases where it has been judged that the interpolation point belongs to the image edge portion, and it has been 
specified that the image edge portion extends along a direction parallel (or perpendicular) to one of the array directions 
of the sampling points in the unit lattice, the interpolated image signal component corresponding to the interpolation 
point is calculated from the original image signal components, which represent the four lattice points (i.e., the four sam- 
pling points), that constitute the unit lattice containing the interpolation point therein. In such cases, the calculation of 
the interpolated image signal component corresponding to the interpolation point, which is located at the image edge 
portion extending along the direction parallel (or perpendicular) to one of the array directions of the sampling points in 
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the unit lattice, may be carried out by using the same operation processes the conventional one. 

In the interpolating operation method and apparatus for an image signal in accordance with the present invention, 
in cases where it has been judged that the interpolation point belongs to the image edge portion, the image density gra- 
dient vector at the interpolation point may be calculated. Also, the distance between the line segment, which intersects 

5 perpendicularly to the image density gradient vector, and each of the sampling points, which are located in the vicinity 
of the interpolation point may be calculated. The interpolation coefficients may then be corrected such that the interpo- 
lation coefficient, by which the original image signal component representing a sampling point is to be multiplied, may 
become small for the sampling point, for which the image density gradient vector and/or the distance is comparatively 
large. With the interpolating operation method and apparatus for an image signal in accordance with the present inven- 

io tion. which are constituted in this manner, when the original image signal components representing the sampling points, 
which are located at positions remote from the line segment (i.e., the image edge portion), are used in the interpolating 
operation, the degrees of contribution of the original image signal components to the interpolating operation can be kept 
low. As a result, the degrees of contribution of the original image signal components representing the sampling points, 
which are located at positions in the vicinity of the image edge portion, i.e. at positions along the image edge portion, 

is to the interpolating operation can be kept relatively high. Therefore, an approximately the same level of image density 
value (interpolated image signal component) as the image density values of the image edge portion is assigned to the 
interpolation point which is located at the image edge portion. Accordingly, the step-like pattern in the original image is 
not enlarged. Even if the image size is enlarged, the problems can be prevented from occurring in that the step-like pat- 
tern at the image edge portion, which extends in the oblique direction, is enlarged. 

20 In cases where it has been judged that the interpolation point belongs to the flat portion in the original image, the 
interpolating operation process enabling the sharpness to be adjusted, such as the spline interpolating operation proc- 
ess or the interpolating operation process, which comprises the combination of the cubic spline interpolating operation 
and the third-order B spline interpolating operation, may be carried out by taking the four lattice points (i.e., the four 
sampling points), that constitute the unit lattice containing the interpolation point therein, as reference and by also using 

25 the original image signal components, which represents the sampling points located around the unit lattice. In this man- 
ner, the sharpness of the flat portion in the image can be adjusted freely, and a reproduced visible image, which has 
good image quality and can serve as an effective tool in, particularly, the accurate and efficient diagnosis of an illness, 
can be obtained. 

30 BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a schematic block diagram showing an image reproducing system provided with an interpolating oper- 
ation apparatus 30, which is a first embodiment of the interpolating operation apparatus for carrying out the inter- 
polating operation method for an image signal in accordance with the present invention, 
35 Figures 2A and 2B are explanatory views showing picture elements, which constitute an original image, 

Figure 3 is an explanatory view showing the minimum square lattice having its vertexes at picture elements, which 
constitute an original image, 

Figures 4A and 4B are explanatory views showing how a unit lattice is divided into two triangular regions, 
Figures 5A and 5B are explanatory views showing how a conventional interpolating operation is carried out, 
40 Figure 6 is a graph showing how sharpness is adjusted, 

Figures 7A and 7B are explanatory views respectively showing an original image and picture elements, which con- 
stitute the original image, the views serving as an aid in explaining how the conventional interpolating operation is 
carried out, 

Figure 8A is an explanatory view showing an interpolation image obtained from the conventional interpolating oper- 
as ation, 

Figure 8B is an explanatory view showing picture elements, which constitute the interpolation image of Figure 8A 
obtained from the conventional interpolating operation, 

Figures 9A, 9B, 9C, and 9D are explanatory views showing examples of how a direction, along which an image 
edge portion extends, is specified by using an image density gradient vector, 
so Figures 10A, 10B. 10C, and 10D are explanatory views showing further examples of how a direction, along which 
an image edge portion extends, is specified by using an image density gradient vector, 

Figures 11 A, 11B, 11C. and 11D are explanatory views showing still further examples of how a direction, along 
which an image edge portion extends, is specified by using an image density gradient vector. 
Figure 12 is a schematic block diagram showing an image reproducing system provided with an interpolating oper- 
ss ation apparatus 30'. which is a second embodiment of the interpolating operation apparatus for carrying out the 
interpolating operation method for an image signal in accordance with the present invention, 
Figure 13 is an explanatory view showing an example of how an image density gradient vector is calculated, 
Figure 14 is an explanatory view showing a different example of how an image density gradient vector is calculated, 
Figure 15 is an explanatory view showing an image density gradient vector, a line segment intersecting perpendic- 
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ularly to the image density gradient vector, and distances between the line segment and sampling points, and 
Figure 16 is a graph showing an example of a correction term. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

5 

The present invention will hereinbelow be described in further detail with reference to the accompanying drawings. 
Figure 1 is a schematic block diagram showing an image reproducing system provided with an interpolating oper- 
ation apparatus 30, which is a first embodiment of the interpolating operation apparatus for carrying out the interpolat- 
ing operation method for an image signal in accordance with the present invention. 

io With reference to Figure 1. the image reproducing system comprises a storage means 10 for storing an original 
image signal Sorg representing an original image, and an input means 21 from which the information representing a 
desired reproduction format is inputted. The image reproducing system also comprises a multi-formatter 20 for carrying 
out predetermined signal processing on the original image signal (hereinbelow also referred to as the primary image 
signal) Sorg, which is received from the storage means 10. such that an image signal conforming to the desired repro- 

75 duction format which has been inputted from the input means 21 , may be obtained. The image reproducing system fur- 
ther Comprises an image reproducing means 60 for reproducing a visible image in the desired reproduction format from 
the image signal (hereinbelow referred to as the secondary image signal or the interpolation image signal) S\ which has 
been obtained from the predetermined signal processing carried out by the multi-formatter 20. 

The multi-formatter 20 carries out the signal processing on the primary image signal Sorg, such that an image sig- 

20 nal conforming to one of various image reproduction formats may be obtained. Examples of the image reproduction for- 
mats include a format, in which the entire area of a single sheet of film is divided into four different small regions and 
four different images having reduced image sizes are printed respectively in the four regions, a format in which a single 
large image is printed directly on a single sheet of film, and a format, in which a portion of an image is enlarged and the 
enlarged image portion is printed on a sheet of film. The multi-formatter 20 is provided with the interpolating operation 

25 apparatus 30 in accordance with the present invention, which carries out an interpolating operation for obtaining the 
secondary image signal made up of a number of image signal components different from that of the image signal com- 
ponents of the primary image signal Sorg when the image size is to be enlarged or reduced. 

As illustrated in Figure 2A. the primary image signal Sorg utilized in this embodiment represents the image com- 
posed of picture elements (i.e., the lattice points indicated by white dots and black dots), which are arrayed in the hori- 

30 zontal and vertical directions in the lattice-like form. In the image, an image edge portion, at which the change in the 
image density (i.e., the value of the primary image signal Sorg) is sharp, extends along an oblique direction inclined 
upwardly to the right with respect to the array directions of the picture elements. In Figure 2A, the picture elements hav- 
ing a high image density are indicated by the black dots, and the picture elements having a low image density are indi- 
cated by the white dots. 

35 The interpolating operation apparatus 30 sets an interpolation point on the original image and in accordance with 
the image size enlargement or reduction scale factor, which has been inputted from the input means 21. The interpo- 
lating operation apparatus 30 comprises an edge presence or absence judging means 31 for making a judgment as to 
whether the interpolation point belongs to an image edge portion or a flat portion in the original image. The interpolating 
operation apparatus 30 also comprises a first interpolating operation means 40, which is used for an interpolation point 

40 belonging to the image edge portion and calculates the secondary image signal component corresponding to the inter- 
polation point, and a second interpolating operation means 50, which is used for an interpolation point belonging to the 
flat portion and calculates the secondary image signal component corresponding to the interpolation point The inter- 
polating operation apparatus 30 further comprises an operation change-over means 32 for changing the first interpolat- 
ing operation means 40 and the second interpolating operation means 50 over to each other in accordance with the 

45 results of the judgment having been made by the edge presence or absence judging means 31. 

The first interpolating operation means 40 comprises an edge extending direction specifying means 41 for discrim- 
inating (i.e., specifying) the direction, along which the image edge portion extends, with respect to the array directions 
of the sampling points (i.e., the picture elements of the original image, which will often be referred to as the lattice 
points) in a unit lattice. The first interpolating operation means 40 also comprises a region dividing means 43 for dividing 

so the unit lattice into two triangular regions with the image edge portion serving as the boundary therebetween, the image 
edge portion extending along an oblique direction with respect to the array directions of the sampling points in the unit 
lattice, and a region selecting means 44 for selecting a triangular region, which contains the interpolation point therein, 
from the two triangular regions. The first interpolating operation means 40 further comprises a first operation means 45 
for calculating the secondary image signal Component of the secondary image signal S' corresponding to the interpo- 

55 lation point, the calculation being made from the primary image signal components of the primary image signal Sorg, 
which represent the three sampling points, that constitute the triangular region containing the interpolation point therein. 
The first interpolating operation means 40 still further comprises a second operation means 46 for calculating the sec- 
ondary image signal component of the secondary image signal S* corresponding to the interpolation point, the calcula- 
tion being made from the primary image signal components of the primary image signal Sorg, which represent the four 
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lattice points, that constitute the unit lattice containing the interpolation point therein. The first interpolating operation 
means 40 also comprises an operation selecting means 42 for selecting either one of the first operation means 45 and 
the 46 in accordance with the results of the specifying carried out by the edge extending direction specifying means 41 . 

In cases where, as a result of the specifying carried out by the edge extending direction specifying means 41 , it has 
been specified that the image edge portion extends along an oblique direction with respect to the array directions of the 
sampling points in the unit lattice, the operation selecting means 42 selects the region dividing means 43 such that the 
first operation means 45 may be used. In cases where, as a result of the specifying carried out by the edge extending 
direction specifying means 41 , it has been specified that the image edge portion extends along a direction parallel to 
one of the array directions of the sampling points in the unit lattice, the operation selecting means 42 selects the second 
operation means 46 such that the second operation means 46 may be used. 

The first operation means 45 stores the information representing the algorithms of a predetermined interpolating 
operation, which will be described later. The first operation means 45 carries out the interpolating operation with the 
algorithms on the received primary image signal Sorg and thereby calculates the secondary image signal S\ 

The second interpolating operation means 50 comprises a sharpness instruction input means 51 for inputting an 
instruction concerning the alteration of sharpness of the flat portion from the exterior. The second interpolating opera- 
tion means 50 also comprises a spline interpolating operation means 52, with which the sharpness of the flat portion is 
capable of being altered in accordance with the instruction inputted from the sharpness instruction input means 51 . 

The spline interpolating operation means 52 stores the information representing an interpolating operation formula, 
which will be described later and is expressed with a polynomial of interpolation coefficients in accordance with the 
sharpness specified from the sharpness instruction input means 51. 

How the image reproducing system provided with this embodiment operates will be described hereinbelow. 

Firstly, information representing a desired image size enlargement scale factor is inputted from the input means 21 
into the multi-formatter 20. 

The multi-formatter 20 sequentially reads the primary image signal Sorg (=Sij, where i, j ~ 1 . 2, ...), which repre- 
sents the picture elements illustrated in Figure 2 A, from the storage means 10. 

Also, in order to obtain the secondary image signal, which represents an enlarged image corresponding to the 
image size enlargement scale factor inputted from the input means 21 . the multi-formatter 20 feeds the primary image 
signal Sorg into the interpolating operation apparatus 30. 

In the interpolating operation apparatus 30, the primary image signal Sorg is firstly fed into the edge presence or 
absence judging means 31 . From the received primary image signal Sij, the edge presence or absence judging means 
3 1 calculates the differences among image signal components Sij. S(i+1)j, SiQ+1 ). and S(i+1 )G+1 ) . which represent the 
lattice points of the minimum square lattice. Specifically, calculations are made to find differences |Sij-S(i+1)j| , 
|Sij-SiO+1)| . |Sij-S(i+1)Q+1)| . IS(i+1)j-SiO+1)| . |S(i+1)j-S(i+1)G+1)| . and |Si(j+1)- S(i+1)(j+1)| . A large difference value 
indicates that a portion, at which the change in the image density is sharp, i.e. the image edge portion, is located 
between the two lattice points associated with the difference value. The edge presence or absence judging means 31 
carries out the calculation with respect to each of the square lattices represented by the primary image signal Sij and 
thereby makes a judgment as to the presence or absence of the image edge portion. 

In the example taken in this embodiment, the values of |Sij-S(i+1)j| , |Sij-Si(j+1)| , and |S(i+1)j-Si(j+1)| are approx- 
imately equal to zero. Also, the values of |Sij-S(i+1)(j+1)|, |S(H-l)j-S(i+1)G+1)|.and |Si(j+1)- S(i+1)G+l)| take a certain 
large value. Therefore, it is judged that the image edge portion is present. 

However, if the presence or absence of the image edge portion is judged from these calculated difference values 
alone, there will be the risk that a granular portion representing radiation noise, or the like, are detected by mistake as 
the image edge portion. In order for such problems to be eliminated, as illustrated in Figure 3, after the calculation has 
been made with respect to the unit lattice a containing the interpolation point therein, the same calculation may also be 
carried out with respect to unit lattices b, c, d, and e, which are located around the unit lattice a. The thus calculated 
values may then be utilized in making the judgment. The setting of the unit lattices around the unit lattice, which con- 
tains the interpolation point therein, and the setting of the sampling points may be earned out in various ways. 

Alternatively, an image density gradient vector with respect to each of two array directions of the sampling points 
may be calculated from the original image signal components representing the four sampling points, which constitute 
the unit lattice containing the interpolation point therein. A judgment as to the presence or absence of the image edge 
portion may then be made from the magnitude and the product of the two calculated image density gradient vectors. 

The information representing the results of the judgment having been made by the edge presence or absence judg- 
ing means 31 is fed into the operation change-over means 32. In cases where it has been judged that the image edge 
portion is present, the operation change-over means 32 changes the interpolating operation means over to the first 
interpolating operation means 40. In cases where it has been judged that the image edge portion is absent, the opera- 
tion change-over means 32 changes the interpolating operation means over to the second interpolating operation 
means 50. 

In cases where it has been judged that the image edge portion is present, the image reproducing system provided 
with this embodiment operates in the manner described below. 
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Specifically, the primary image signal Sorg is fed into the first interpolating operation means 40. In the first interpo- 
lating operation means 40. as in the edge presence or absence judging means 31 , the edge extending direction spec- 
ifying means 41 calculates the differences among the image signal components Sij, S(M)j, Si(j+1). and S(i+1)G+1) . 
which represent the lattice points of the minimum square lattice, from the received primary image signal Sij. Specifically, 

5 calculations are made to find the differences |Sij-S(i+1)j| , |Sij-Si(j+1)| , |Sij- S(i+ 1)0+1 )| , |S(i+1)j -Si 0+1)1 . 
|S(i+1)j-S(i+1)(j+1)| , and |Si(j+1)-S(i+1)G+1)| . From the calculated difference values, the edge extending direction 
specifying means 41 specifies the direction, along which the image edge portion extends. 

In the example of Figure 2A, the values of |Sij-S(i+1)0+1)| . |S(i+1)j-S(i+1)(j+1)I . and |SiQ+1)- S(i+1)(j+1)| take a 
certain large value. Also, the values of |Sij-S(i+1)j| . |Sij-SiG+1)| . and |S(i+1)j-SiQ+1)| are not large. Therefore, it can 

10 be specified that the image edge portion extends along the Oblique direction inclined upwardly to the right with respect 
to the array directions of the sampling points. 

In cases where the values of |Sij-S(i+l)j| and |Si(j+l)-S(i+l)(j+l)| take a small value and, at the same time, the 
values of |Sij-Si(j+1)| and |S(i+1)j-S(i+1)(j+1)| take a large value, it is specified that the image edge portion extends 
along the horizontal direction. In cases where the values of [Sij-SiG+1)| and |S(i+1)j-S(i+1)(j+1)| take a small value 

15 and, at the same time, the values of |Sij-S(i+1)j| and |Si(j+1)-S(i+1)G+1)| take a large value, it is specified that the 
image edge portion extends along the vertical direction. 

As in making the judgment as to the presence or absence of the image edge portion, after the calculation has been 
made with respect to the unit lattice a containing the interpolation point therein, the same calculation may also be car- 
ried out with respect to the unit lattices b, c. d, and e, which are located around the unit lattice a. The thus calculated 

so values may then be utilized in specifying the direction, along which the image edge portion extends. Alternatively, the 
image density gradient vector with respect to each of two array directions of the sampling points may be calculated from 
the original image signal components representing the four sampling points, which constitute the unit lattice containing 
the interpolation point therein. The direction, along which the image edge portion extends, may then be specified from 
the magnitude and the product of the two calculated image density gradient vectors. 

25 How the cfirection, along which the image edge portion extends, is specified from the magnitude and the product of 

the image density gradient vectors will be described hereinbelow. 

An image density gradient vector I with respect to an array direction i of the sampling points in the unit lattice con- 
taining the interpolation point therein and an image density gradient vector J with respect to an array direction j of the 
sampling points in the unit lattice Containing the interpolation point therein can be calculated with the formulas shown 

30 below. 

J ( B JH{S^ 1)O+1) -»5 ifl+1) HS a+1 jj+S 0 }]r 

35 

wherein each of i and j represents the unit vector in the array direction of the sampling points. 

The magnitude |l| of the image density gradient vector I and the magnitude |J| of the image density gradient vector 
J are taken into consideration, and the difference (|I|-|JI) between them is compared with a predetermined threshold 
value T1, where T1>0, and a predetermined threshold value -T1. From the results of the comparison, the direction, 
40 along which the image edge portion extends, with respect to the array directions of the sampling points in the unit lattice 
can be specified. 

Specifically, the direction, along which the image edge portion extends, can be specified in the manner described 
below. 

45 (a) rf (|I|-|J|)>T1 , it can be specified that the image edge portion is a vertical image edge portion. 

(b) If (|I|-|J|)<-T1 , it can be specified that the image edge portion is a horizontal image edge portion. 

(c) If -T1 <(|I|-|J|)<T1 , it can be specified that the image edge portion is an oblique image edge portion. 

The term Vertical image edge portion" as used herein means the image edge portion extending in the direction 
so parallel to the direction, that connects the sampling points Sij and Si(j+1) with each other. The term "horizontal image 
edge portion" as used herein means the image edge portion extending in the direction parallel to the direction, that con- 
nects the sampling points Sij and S(i+1)j with each other. The term "oblique image edge portion" as used herein means 
the image edge portion extending in the direction parallel to the direction, that connects the sampling pants Sij and 
S(i+1)G+1) with each other, or that connects the sampling points SiQ+1) and S(i+1)j with each other, 
ss As for the oblique image edge portion, in order for its direction to be specified, the product of the two image density 
gradient vectors I and J is compared with a predetermined threshold value T2, where T2>0. and a predetermined 
threshold value -T2. From the results of the comparison, it is specified along which diagonal direction of the unit lattice 
the image edge portion extends. The product is calculated with the formula shown below. 
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1 * J =[{S (i+ , )0+ i ) +S 0+1)j HS i0+1) +S ij }] ^[{S^^j+S^WSp.^+S,}] 
Specifically, the direction of the oblique image edge portion is specified in the manner described below. 

5 

(d) If [{S(i+1)i+S(i+1)G+1)}-{Sij+SiG+1)}] ><t{SiG+1)+S(i+1)(j+1)HSij+S(i+1)j}]>T2 , it can be specified that the 
oblique image edge portion is inclined upwardly to the right as illustrated in Figures 9A, 9B, 9C. and 9D. 

(e) If [[S(i+1)j^(i+l)G+^ it can be specified that the 
oblique image edge portion is inclined upwardly to the left as illustrated in Figures 10A, 10B, 10C, and 10D. 

io (f) If -T2<[{S(i+1)i+S(i+1)G+1)}-{Sij+SiG+1)}] xt{SiG+1)+S(i+1)(j+1)HSij+S(i+1)j}]<T2 , the direction of the oblique 
image edge portion can be specified as follows: 

if Sij>S(i+1)j , it can be specified that the oblique image edge portion is inclined upwardly to the right as illus- 
trated in Figure 11 A, and 

75 »f Sij<S(i+1)j , it can be specified that the oblique image edge portion is inclined upwardly to the left as illus- 

trated in Figure 1 1 B. 

In this manner, since the discrimination of the direction, along which the image edge portion extends, is difficult, the 
direction connecting the diagonal sampling points, which have a low image density, with each other is preferentially 
20 taken as the edge extending direction such that, in cases where the image is a character pattern, importance may be 
attached to the connection of the character pattern. In the cases of (f). if the values of Sij and S(i+1)j are approximately 
equal to each other, it can be considered that, as illustrated in Figures 1 1 C and 1 1 D, the four sampling points constitut- 
ing the unit lattice have approximately uniform image density. Therefore, in such cases, it can be specified that the 
image edge portion is not present in the image constituted by the unit lattice. 
25 In a modification of this embodiment, the edge presence or absence judging means 3 1 may also have the functions 

of the edge extending direction specifying means 41 and may specify the edge extending direction when making the 
judgment as to the presence or absence of the image edge portion. In such cases, the edge extending direction spec- 
ifying means 41 may be omitted. 

The information representing the results of the specifying of the direction, along which the image edge portion 
30 extends, is fed into the operation selecting means 42. In cases where it has been specified that the direction, along 
which the image edge portion extends, is the oblique direction, the operation selecting means 42 selects the region 
dividing means 43, which is connected to the first operation means 45. In cases where it has been specified that the 
direction, along which the image edge portion extends, is the vertical direction or the horizontal direction, the operation 
selecting means 42 selects the second operation means 46. The operation selecting means 42 feeds the primary image 
35 signal Sorg to the selected means, i.e. the region dividing means 43 or the second operation means 46. 

In cases where it has been specified that the direction, along which the image edge portion extends, is the oblique 
direction, as illustrated in Figure 2B, the region dividing means 43 divides the unit lattice, which is composed of the sam- 
pling points a. b, c, and d and contains an interpolation point S'ij therein, into two triangular regions (Aabd and Abed) by 
the diagonal line connecting the two lattice points b and d, that are adjacent to each other along the direction, along 
which the image edge portion extends (in this example, the oblique direction inclined upwardly to the right). 

Thereafter, the region selecting means 44 selects the triangular region (in the example of Figure 2B, Aabd). which 
contains the interpolation point S'ij therein, from the thus divided two triangular regions. In cases where the interpolation 
point Sij lies on the diagonal line (b-d), along which the unit lattice is divided, the region selecting means 44 compares 
the image density value (i.e.. the value of the primary image signal Sorg) of the lattice point (a), which is other than the 
two lattice points (b, d) lying on the diagonal line among the three lattice points (a. b. d) constituting the triangular region 
(Aabd), and the image density values of the two lattice points (b. d) lying on the diagonal line. Also, the region selecting 
means 44 compares the image density value of the lattice point (c), which is other than the two lattice points (b. d) lying 
on the diagonal line among the three lattice points (b, c, d) constituting the triangular region (Abed), and the image den- 
sity values of the two lattice points (b, d) lying on the diagonal line. The region selecting means 44 then selects the tri- 
angular region (in this example, Aabd) containing the lattice point (a), the image density value of which is closer to the 
image density values of the two lattice points (b. d) lying on the diagonal line than the image density value of the lattice 
point (c) is. 

The region selecting means 44 extracts (i.e., selects) the three lattice points (a, b. d). which constitute the selected 
triangular region (Aabd). 

In general, as illustrated in Figures 4A and 4B, a set of the primary image signal components, which represent the 
three lattice points corresponding to the vertexes of one of triangular regions 1. 2, 3, and 4, is extracted (selected) in 
accordance with the direction, along which the image edge portion extends, and the position of the interpolation point. 
For example, in cases where the interpolation point is located within the triangular region 1 , which has a side extending 
along the oblique direction inclined upwardly to the right, the lattice points a. b. and d are extracted. In cases where the 
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interpolation point is located within the triangular region 3, which has a side extending along the oblique direction 
inclined upwardly to the left, the lattice points a, b, and c are extracted. 

The primary image signal components Sij. S(i+1)j, and SiQ+1) representing the thus extracted lattice points Sij. 
S(i+1)j, and SiQ+1) are fed into the first operation means 45. The first operation means 45 calculates the secondary 
image signal component S'ij, which corresponds to the interpolation point S'ij, from the three received primary image 
signal components Sij, S(i+t)j. and Si(j+1). 

The algorithms for the calculation of the secondary image signal component S'ij will hereinbelow be described in 
detail with reference to Figure 2B. 

The interval between the lattice points Sij and S(i+1)j and the interval between the lattice points Sij and SiQ+1) are 
respectively taken as being equal to the unit length of 1 . Also, as illustrated in Figure 2B, the distance between the lat- 
tice point Sij and the interpolation point S ij. the distance being taken along the x axis direction (i.e., the horizontal direc- 
tion), is represented by Tx. The distance between the lattice point Sij and the interpolation point S'ij. the distance being 
taken along the y axis direction (i.e., the vertical direction), is represented by Ty. In such cases, an image signal com- 
ponent Sm corresponding to a virtual interpolation point Sm, that corresponds to the position of the interpolation point 
S'ij taken from the lattice point Sij along the x axis direction, is calculated with the linear interpolating operation repre- 
sented by Formula (31 ) shown below. Also, an image signal component Sn corresponding to.a virtual interpolation point 
Sn, that corresponds to the position of the interpolation point S'ij taken on the line connecting the lattice points S(i+1)j 
and SiQ+1 ) with each other (i.e., the line in the direction, along which the image edge portion extends), is calculated with 
the linear interpolating operation represented by Formula (32) shown below. 

Sm=(1-Tx)Sij+TxS(i+1)j (31) 

Sn=(1-Tx)SiQ+1)+TxS(i+1)j (32) 

Thereafter, a linear interpolating operation is carried out for the interpolation point S'ij and with respect to the y axis 
direction by using the image signal components Sm and Sn. and the secondary image signal component Sij is thereby 
calculated. The linear interpolating operation is represented by Formula (33) shown below. 

Slj=(1-Tx-Ty)Sij+TySiQ+1) +TxS(i+1)j (33) 

The secondary image signal component Sij. which corresponds to the interpolation point S'ij and has been calcu- 
lated with Formula (33) is not affected by the lattice point S(i+1)Q+1) . which is located at the position crossing the 
image edge portion and has a markedly different image density value. Therefore, even if the interpolation point lies on 
the image edge portion, the secondary image signal component corresponding to the interpolation point will depend 
upon only the primary image signal components SiQ+1) and SQ+1)j representing the lattice points, which are located 
along the direction, along which the image edge portion extends. Accordingly, the problems do not occur in that an inter- 
polated point having a markedly different signal value occurs on the image edge portion. 

The calculation of the se^ndary image signal component S'ij with Formula (33) is the one for the cases where the 
interpolation point is located within the triangular region 1 shown in Figure 4A. In cases where the interpolation point is 
located within one of the other triangular regions 2, 3. and 4 shown in Figures 4A and 4B, the secondary image signal 
component can be calculated inthe same manner. 

Specifically, in cases where the interpolation point is located within the triangular region 2, the secondary image 
signal component Sij corresponding to the interpolation point can be calculated with Formula (34) shown below. 

Slj=(1 -Tx)SiQ+1)+(1 -Ty )S(i+1)j +(Tx+Ty-1)S(i+1)Q+1) (34) 

In cases where the interpolation point is located within the triangular region 3, the secondary image signal compo- 
nent S'ij corresponding to the interpolation point can be calculated with Formula (35) shown below. 

Slj=(1-Ty)Sij+(Ty-Tx)SiQ+1)+TxS(i+1)Q+1) (35) 

In cases where the interpolation point is located within the triangular region 4, the secondary image signal compo- 
nent Sij corresponding to the interpolation point can be calculated with Formula (36) shown below. 

Slj=(1-Tx)Sij+(Tx-Ty)S(i+1)j +TyS(i+1)Q+1) (36) 

The first operation means 45 stores the information representing Formulas (33), (34), (35), and (36). The first oper- 
ation means 45 selects the calculation formula, which is to be used, from Formulas (33), (34), (35). and (36) in accord- 
ance with the primary image signal components, which represent the lattice points having been extracted by the region 
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selecting means 44. Also, the first operation means 45 calculates the secondary image signal component S'ij, which 
corresponds to the interpolation point, by using the selected calculation formula. 

In cases where it has been specified that the direction, along which the image edge portion extends, is the vertical 
direction or the horizontal direction, the second operation means 46 is selected, and the primary image signal Sorg is 
fed into the second operation means 46. 

The second operation means 46 carries out a known interpolating operation on the image signal components Sij, 
S(i+1)j. SiO+1), and S(i+1)(j+1) representing the four lattice points a. b, c. and d, which constitute the unit lattice con- 
taining the interpolation point Sij therein. In this manner, the second operation means 46 calculates the image signal 
component of the interpolation image signal S* corresponding to the interpolation point S\ 

Specifically, as illustrated in Figure 5B ( the interpolated image signal components Sm and Sn, which respectively 
correspond to the interpolation points Sm and Sn, that correspond to the positions of the interpolation point Sij taken 
along the x axis direction, are calculated with linear interpolating operations represented by Formulas (31) and (37) 
shown below. 

Sm=(1-Tx)Sij+TxS(i+1)j (31) 

Sn=(VTx)SiG+1)+TxS(i+1)(j+1) (37) 

Thereafter, a linear interpolating operation is carried out for the interpolation point S'ij and with respect to the y axis 
direction by using the interpolated image signal components Sm and Sn, and the secondary image signal component 
S'ij is thereby calculated. The linear interpolating operation is represented by Formula (30) shown below. 

Slj=(1 -Ty )Sm+TySn (30) 

The same operations as those described above are also carried out for the other interpolation points, and the cor- 
responding image signal components of the interpolated image signal S* are thereby obtained. 

In cases where the direction, along which the image edge portion extends, is the vertical direction or the horizontal 
direction, even if the interpolating operation depending upon the original image signal components representing the 
four lattice points described above is carried out, an interpolation point having a markedly different signal value does 
not occur on the image edge portion. 

in cases where it has been judged by the edge presence or absence judging means 31 that the image edge portion 
is absent, the processing described below is carried out. 

In such cases, the operation change-over means 32 receives the results of the judgment having been made by the 
edge presence or absence judging means 31 and changes the interpolating operation means over to the second inter- 
polating operation means 50. The primary image signal Sorg is fed into the spline interpolating operation means 52. 

The spline interpolating operation means 52 stores a third-order spline interpolating operation formula, e.g. For- 
mula (1) shown below, and formulas for calculating interpolation coefficients, e.g. Formulas (8), (9). (10), and (11) 
shown below, which are set in accordance with the sharpness. The spline interpolating operation means 52 calculates 
the secondary image signal S* in accordance with the received primary image signal Sorg by using these formulas. 



s = a k-i s n-1 + a k s k+a k+i s k+i +a k + 2 S k + 2 ( 1 ) 

a k . 1=! -(a/2)t(M) 2 (8) 

a k =(2-a/2)t 3 -(3-a/2)t 2 +1 ( 9 ) 

a K+1 =(o/2-2)t 3 +(3-a)t 2 +<a/2)t ( 10 ) 
a K+2 =(a/2)t 2 (t-1) 



in which a represents the parameter determining the sharpness of a secondary image represented by the interpolation 
image signal obtained from the interpolating operation, and t. where 0stf<1 , represents the position of the interpolation 
point X s \ the position being taken with respect to the picture elements X k , that serves as a reference position, and in 
the direction heading toward the picture element X k+1 , the lattice interval of the primary image signal components being 
set to be equal to 1 . 

How the spline interpolating operation means 52 carries out the interpolating operation will hereinbelow be 
described in detail. 

As an aid in facilitating the explanation, as illustrated in Figure 6, of the picture elements of the original image rep- 
resented by the primary image signal Sorg, only the picture elements X k . 2 . X k . 1t X* X k+1 , X^ which are arrayed 
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along a single predetermined direction, e.g. along the j'th row in the array of the picture elements, are considered. 

The primary image signal components representing the picture elements X k _ 2 , X k _ v X k , X^, X^, ... are repre- 
sented respectively by S k _ 2 {=S(i-2)j} , S M {=S(M)j} . S k {=Sij} , S k+1 {=S(i+1)j} . S k+2 {=S(i+2)j} . ... 

Firstly, in cases where the interpolation point Xg' fails within a section Xk~X k+1 , a spline interpolating function f k cor- 
responding to the section X k -X k+1 is represented by Formula (38) shown below. 

f k {x)=A k x 3 +B k x 2 +C k x+D k (38) 

In the operation formula. Formula (38). the conditions should be satisfied in that the spline interpolating function f k 
should pass through the original sampling points (picture elements), and in that the first-order differential coefficient of 
the spline interpolating function f k should be continuous between adjacent sections. From such conditions. Formulas 
(2). (3), (4). and (5) are derived. 

M*k>=S k (2) 
M X k+l) = ®k+l (3) 
V(Xk>=fk-i'<Xk> W 
k+1 M k+1 ( X k+1 ) (5) 

In these formulas, f k ' represents the first-order differentiation (3A h x 2 +2B k x+C k ) of the function f k . 

Also, the condition should be satisfied in that the first-order differential coefficient of the spline interpolating function 
f k at the picture element X k should have a predetermined inclination a with respect to the gradient 
( s k+1 " s k-i V( x k+i " x k-i ) the original image signal components S^-, and Sk +1 representing the picture elements X k . 
1 a n d X k+1 , which are located before and after the picture element X^ Therefore, it is necessary for Formula (6) shown 
below to be satisfied: 



f k (X k )=a(S M -S ko )/(X M -X M ) (6) 

Further, the condition should be satisfied in that the first-order differential coefficient of the spline interpolating func- 
tion f k at the picture element X k+1 should have the predetermined inclination a with respect to the gradient 
( S k+2- S k) 7 ( X k+2" X k) °f to* original image signal components ^ and representing the picture elements X k and 
x k+2. which are located before and after the picture element X k+1 . Therefore, it is necessary for Formula (7) shown 
below to be satisfied: 

*kX X k+i)=a(S k+2 -S k )/(X k+2 -X k ) (7) 

The interval (i.e.. the lattice interval) 6f each of sections X^-X^, X k . 1 -X k , X k ^X k+1 . and X^-X^ is herein set 
to be equal to 1 . Also, the position of the interpolation point Xg', which is taken from the picture element X k in the direc- 
tion heading toward the picture element X k+1 . is represented by t (0^<1). In such cases, from Formulas (2), (3). (4), (5). 
(6). and (7), the formulas shown below obtain. 

f k (0)=D k =S k 
f k (1)=A k+ B k +C k +D k =S k+1 

f k '(1 )=3A k+ 2B k+ C k =a(S k+2 -S H )/2 
Therefore, the formulas shown below obtain. 



A k =(a/2)S k ^ 2 +(a/2-2)S k+1 +(2-a/2)S k -(a/2)S k ^ 
B k =-(a/2)S k+2 +(3-a)S KO +(a/2-3)S k +aS M 



C k =(a/2)S k+l -(a/2)S k . 1 
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As described above, the variable conversion of X=t is carried out, and therefore the spline interpolating function 
f k (x) is represented by the formula shown below. 

Mx)=f k (t) 

Therefore, the image signal component of the secondary image signal S* corresponding to the interpolation point X s ' 
may be represented by Formula (39) shown below. 

S'=f k (t)=A k t 3 +B k t 2 + C k t + D k (39) 
Substituting the coefficients A*, Bk, C^, and D k into Formula (39) yields 

S={(a/2)S k+2+ (a/2-2)S k+1 +(2-a/2)S k -(a/2)S ^Jt 3 +{-<a/2)S k+2 +(3-a)S k+1 
♦(a/S^S.+aS^Jt 2 +{(a/2)S k+l -(a/2)S k _ 1 }t+S k 

Arranging this formula with respect to the image signal components S^, S k , Sk +1 . and Sk +2 yields Formula (40) shown 
20 below. 

^MMI^Sm +{(2-a/2)t 3 +(ci/2-3)t 2 +1}S k 4^(a/2-2)t 3 4.(3-a)t 2 +at^}S k+1 +{-at 2 (t-1)/2)S k+2 (40) 

The interpolation coefficients a^. a*, a,^, and a^ corresponding to the original image signal components S^. 
25 S|<. S k+1> and are calculated with the algorithms described above. 

As will be understood from Formulas (6) and (7) and Figure 6, as the value of the parameter a is set to be larger, 
the contrast of the secondary image becomes higher, and an image having a higher sharpness is obtained. As the 
value of the parameter a is set to be smaller, the contrast of the secondary image becomes lower, and a smoother 
image having a lower sharpness is obtained. Therefore, the sharpness of the flat portion can be adjusted freely by 
inputting the instruction for the alteration of the parameter a from the sharpness instruction input means 51 . The input 
of the instruction for the alteration of the parameter a includes the input of the instruction for increasing or reducing the 
parameter a and the direct input of the value of the parameter a. 

An actual image is composed of the picture elements arrayed in two-dimensional directions. Therefore, the param- 
eter t which is used in the aforesaid interpolation coefficient formulas, may be replaced by t x with respect to one of the 
two directions in the array and may be replaced by t y with respect to the other direction in the array. The interpolation 
coefficients may thus be determined for each of the directions in the array. The spline interpolating operation means 52 
stores the information representing the thus set interpolation coefficients. 

The thus obtained secondary image signal S" corresponding to all of the interpolation points is fed into the image 
reproducing means 60. 

The image reproducing means 60 reproduces a visible image from the received secondary image signal S\ As 
described above, in cases where the interpolation point belongs to the image edge portion and the direction, along 
which the image edge portion extends, is an oblique direction with respect to the array directions of the sampling points 
in the unit lattice, the interpolated image signal component corresponding to the interpolation point is calculated from 
the primary image signal components, which represent the three lattice points constituting a predetermined triangular 
region. As a result, the interpolated image signal component corresponding to the interpolation point located at the 
oblique image edge portion does not depend upon the primary image signal component, which represents the lattice 
point having a markedly different image density value. Therefore, in the reproduced visible image, an interpolated point 
having an intermediate level of image density does not occur in a high image density region or a low image density 
region. 

In cases where the interpolation point belongs to the image edge portion and the direction, along which the image 
edge portion extends, is parallel to one of the array directions of the sampling points in the unit lattice, the interpolated 
image signal component corresponding to the interpolation point is calculated from the primary image signal compo- 
nents, which represent the four lattice points (sampling points) constituting the unit lattice, to which the interpolation 
point belongs. In this manner, the interpolated image signal component corresponding to the interpolation point, which 
is located at the image edge portion extending in the horizontal or vertical direction, can be calculated with the same 
interpolating operation process as the conventional one. 

In the spline interpolating operation means 52, in lieu of the algorithms described above. Formulas (1), (16), (17), 
(18), and (19) shown below may be utilized in order to set the interpolation coefficients a k . 1( a*. a k+1 . and corre- 
sponding to the original image signal components Sk.-,, Sk. Sk +1 , and S k+2 . 
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S'=a M S k0 +a k S k +a k+1 S k+1 +a k+2 S k+2 (1 ) 

a^HP+i^M^sp^+lJt 2 (l/2)t-p/2 (16) 

a k =3(p+1/2)t 3 -(9p/2+5/2)t 2 +p+1 (17) 

a k+1 =-3(p+1/2)t 3 +(9p/2+2)t 2 +(1/2)t-p/2 (18) 

a k+2 =(P+1/2)t 3 -(3p/2 + 1/2)t 2 (19) 



In these formulas, as in a, p represents the parameter determining the sharpness of the secondary image repre- 
sented by the interpolation image signal obtained from the interpolating operation. However, a is the value concerning 
the image density gradient at the interpolation point, and p is the value representing the amount of shift (the difference 
in signal value) of the interpolation point from the sampling points. Specifically, in the interpolating operation process 
utilizing p, the interpolation point need not pass through the sampling points in the original image, and therefore the 
sampling points do not necessarily constitute part of the interpolation points. Accordingly, by the control of the shift 
amount, the sharpness of the interpolation image can be adjusted. 

As different examples of the algorithms, the interpolation coefficients a k .t , a^, a^-j, and a^ + 2 corresponding to the 
original image signal components S^. Sk. S k+1 , and S^g may be set in accordance with Formulas (1), (20). (21), (22). 
and (23) shown below, in which both of the control of the sharpness with the parameter a and the control of the sharp- 



ness with the parameter p are utilized. 

S*s=a h . 1 S k . t +a K S k +a k+1 S k+1 +a k+2 S k+2 (1) 

a^iH(^+2p+1)/4}t 3 +{(2a+3p+2)/4]t 2 -{(a+1)/4}t-p/4 (20) 

a k ={(-a+6p+7)/4}t 3 +{(a-9p-11)/4}t 2 +p/2+1) (21 

a M ={(a-6p-7)/4)t 3 +{(-2a+9p+1 0)/4)t 2 +{(a+1 )/4}t-p/4 (22) 

a k+2 ={(a+2 p+1 )/4}t 3 -{(a+3p+1)/4}t 2 {23 ) 



In such cases, the sharpness of the flat portion in the interpolation image can be adjusted freely by changing the 
values of the parameter a and the parameter p. 

As described above, with this embodiment of the interpolating operation apparatus, in cases where the interpola- 
tion point is located at the image edge portion, three or four sampling points appropriate for the calculation of the sec- 
ondary image signal component corresponding to the interpolation point are selected, and the secondary image signal 
component is calculated from the original image signal components representing the selected sampling points. There- 
fore, a markedly different signal value is not given to the interpolation point, which is located at the image edge portion. 
Accordingly, a step-like pattern is not enlarged at the oblique image edge portion. 

In cases where the interpolation point is located at the flat portion, the interpolated image signal component corre- 
sponding to the interpolation point is calculated with the ordinary cubic spline interpolating operation and from the 
image signal components representing the surrounding lattice points, which constitute the unit lattice containing the 
interpolation point therein. The image is reproduced from the thus obtained interpolation image signal. When neces- 
sary, the instruction for the alteration of the sharpness can be inputted by the person, who views the image, and the 
sharpness of the flat portion can thereby be adjusted. Accordingly, a visible image having good image quality can be 
reproduced from the interpolation image signal and used as an effective tool in, particularly, the accurate and efficient 
diagnosis of an illness. 

A second embodiment of the interpolating operation apparatus for carrying out the interpolating operation method 
for an image signal in accordance with the present invention will be described hereinbelow. 

Figure 12 is a schematic block diagram showing an image reproducing system provided with an interpolating oper- 
ation apparatus 30'. which is the second embodiment of the interpolating operation apparatus for carrying out the inter- 
polating operation method for an image signal in accordance with the present invention. The interpolating operation 
apparatus 30* illustrated in Figure 12 is the same as the interpolating operation apparatus 30 illustrated in Figure 1, 
except for a first interpolating operation means 40* and a second interpolating operation means 50'. In the interpolating 
operation apparatus 30* illustrated in Figure 12, the first interpolating operation means 40* comprises an interpolation 
coefficient calculating means 41 • for calculating each of interpolation coefficients, by which the corresponding one of the 
original image signal components is to be multiplied, from the original image signal components of the primary image 
signal Sorg, which represent four sampling points located in the vicinity of the interpolation point (ordinarily, the four lat- 
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tice points constituting the unit lattice). The first interpolating operation means 40' also comprises an image density gra- 
dient vector and distance calculating means 42* for calculating an image density gradient vector at the interpolation 
point on the original image, which is represented by the original image signal components, and calculating the distance 
between a line segment, which intersects perpendicularly to the image density gradient vector, and each of the sarn- 

5 pling points (the original picture elements) utilized in the interpolating operation. The first interpolating operation means 
40' further comprises a correction term calculating means 43* fa calculating a correction term for correcting the inter- 
polation coefficients, which have been calculated by the interpolation coefficient calculating means 4V, in accordance 
with the magnitude of the image density gradient vector and/or the length of the distance between the line segment, 
which intersects perpendicularly to the image density gradient vector, and each of the original picture elements utilized 

10 in the interpolating operation, the image density gradient vector and the distance having been calculated by the image 
density gradient vector and distance calculating means 42\ The first interpolating operation means 40' still further com- 
prises a correction means 44* for correcting the interpolation coefficients, which have been calculated by the interpola- 
tion coefficient calculating means 41'. with respect to the correction term, which has been calculated by the correction 
term calculating means 43\ such that the interpolation coefficient may become small for a sampling point, for which the 

is image density gradient vector and/or the distance is comparatively large. The first interpolating operation means 40* 
also comprises an operation processing means 45* for multiplying the original image signal component by the corre- 
sponding interpolation coefficient, which has been corrected by the correction means 44\ In the interpolation coefficient 
calculating means 41', the interpolation coefficients may be calculated with, for example, the cubic spline interpolating 
operation. With the cubic spline interpolating operation, the interpolation coefficients a^, a*. a^. and a»< +2 are calcu- 

20 lated with the formulas shown below, which are obtained by setting a to be equal to 1 in Formulas (8), (9). (10), and (11) 
shown above. 



a^-Ut-l) 2 ^ 
a k =(3t 3 -5t 2 +2V2 
a k+1 =(-3t 3 +4t 2 +t)/2 
a k+2 =t 2 (t-1)/2 

Also, in the interpolating operation apparatus 30* illustrated in Figure 12. the second interpolating operation means 
50' comprises a cubic spline interpolation coefficient storing means 52*. a B spline interpolation coefficient storing 
means 51 \ an interpolation coefficient operation means 53\ and an interpolating operation means 54*. 

The cubic spline interpolation coefficient storing means 52' stores information representing interpolation coeffi- 
cients CK_ 1t Ck. Ck +1 . and Ck +2 in the cubic spline interpolating operation, which are represented by the formulas shown 
below. 



40 C k =(3t 3 -5t 2 +2)/2 

C k+1 =(-3t 3 4t 2 +t)/2 



45 



55 



c k+2 =t 2 (M)/2 



The B spline interpolation coefficient storing means 51* stores information representing interpolation coefficients 
bk-1. bk. bk+1. and b»< +2 in the third-order B spline interpolating operation, which are represented by the formulas shown 
below. 

50 b K . 1= (-t 3 +3t 2 -3t+1)/6 

b k =(3t 3 -6t 2 +4)/6 
b k+1 =(-3t 3 +3t 2 +3t+1)/6 
b k+2 =t 3 /6 

The interpolation coefficient operation means 53* receives the interpolation coefficients (hereinbelow referred to as 
the cubic spline interpolation coefficients) Ck^, c^, and Ck +2 from the cubic spline interpolation coefficient storing 
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means 52' and receives the interpolation coefficients (hereinbelow referred to as the B spline interpolation coefficients) 
b k _ 1( bk, bfc+v and t\+2 f rom * ne B spline interpolation coefficient storing means 5V. The interpolation coefficient oper- 
ation means 53' carries out the linear combination of the cubic spline interpolation coefficients c^, Ck+i. and 
and the B spline interpolation coefficients b^ , \\. b|< +1 , and b^. which coeff icierrts correspond to each other and are 
s set for the respective original image signal components , S k+1 , and Sk +2 - 

The linear combination is carried out with Formulas (46). (47), (48), and (49) shown below and in accordance with 
a weight factor a. which is inputted from the sharpness instruction input means 51 . 



ak-i«0- a > c M +ab k-i («) 
={(2a-3)t 3 -(3a-6)t 2 -3t+a}/6 

a k =(1-a)c k +ab K (47) 
={(9-6a)t 3 +(9a-1 5)t 2 +(6-2a)}/6 



a K+1 =(1-a)c k+1 +ab k+1 (48) 
={(6a-9)t 3 -(9a-12)t 2 +3t+a}/6 

20 

^2 = 0' a ) c k^ ab ^Z (49) 
={(3-2a)t 3 +(3a-3)t 2 }/6 

25 The interpolating operation means 54* stores the information representing Formula (1 ) shown above as the opera- 
tion formula with the spline interpolating function. The interpolating operation means 54' calculates the value of the 
interpolated image signal component S\ which corresponds to the interpolation point S\ with Formula (1). The calcula- 
tion is made from the interpolation coefficients a*.! , a k . a k+1 . and a^ according to the parameter a. which have been 
calculated by the interpolation coefficient operation means 53*. and the original image signal components , S*. , 

30 and S|< + 2- 

The parameter a can take all real numbers, including the range more than 1 and the range less than 0. 

In cases where it has been judged by the edge presence or absence judging means 31 that the image edge portion 
is present, the image reproducing system provided with this embodiment operates in the manner described below. 

Specifically, the primary image signal Sorg is fed from the storage means 10 into the interpolation coefficient cal- 
35 culating means 41 * and the image density gradient vector and distance calculating means 42'. The interpolation coeffi- 
cient calculating means 41' calculates the interpolation coefficients a k . 1t a*. a k+1 , and a k+2 with the formulas shown 
below in accordance with the aforesaid cubic spline interpolating operation. 

a K . n =-t(t-1) 2 /2 

40 

a k =(3t 3 -5t 2 +2)/2 

a k+1 =(-3t 3 +4t 2 +t)/2 

45 a k+2 =t 2 (t-1)/2 

An actual original image is composed of the picture elements arrayed in two-dimensional directions. Therefore, the 
parameter t, which is used in the aforesaid interpolation coefficient formulas, may be replaced by t x with respect to one 
of the two directions in the array and may be replaced by t y with respect to the other direction in the array. The interpo- 
se lation coefficients are thus determined for each of the directions in the array. 

The image density gradient vector and distance calculating means 42* calculates the image density gradient vector 
at the interpolation point and the distance between the line segment, which intersects perpendicularly to the image den- 
sity gradient vector, and each of the sampling points, which are represented by the original image signal components 
and are utilized in the interpolating operation. Specifically, as illustrated in Figure 13. 16 sampling points located in the 
55 vicinity of the interpolation point S\ for which the interpolated image signal component S' is to be calculated, are 
grouped into four regions a, b, c. and d. The total sum Wa of the original image signal components in the region a is 
calculated. Also, the total sums Wb, Wc, and Wd of the original image signal components in the regions b, c, and d are 
respectively calculated. From the total sums Wa. Wb. Wc, and Wd. an image density gradient vector Sy is calculated 
with the formula shown below. 
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y v =(Wb-wa, Wd-wc) 

Alternatively, as illustrated in Figure 14, the image density gradient vector S v may be calculated with the formula 
shown below from the original image signal components S A , S B . S c . and Sr> which represent the four sampling points 
S A , S B , S c , and So located in the vicinity of the interpolation point S\ for which the interpolated image signal component 
S' is to be calculated. 

S V =((S B+ S D MS A +S C ).(S C +S D )-(S A+ S B )) 

After the image density gradient vector S v has thus been calculated, as illustrated in Figure 1 5, a line segment L^, 
which intersects perpendicularly to the image density gradient vector Sv. is determined. In the calculation of the inter- 
polated image signal component S* corresponding to the interpolation point S\ the original image signal components 
S A . S b . S c . and S|> which represent the four sampling points S A , S B . Sc. and S D located in the vicinity of the interpola- 
tion point S\ are respectively multiplied by the corresponding interpolation coefficients a A , a B , a^ and ar> In tNs embod- 
iment, the interpolation coefficients a A . a B . ac. and ar> by which the corresponding original image signal components 
S A . S B , Sc. and S D are multiplied, are corrected in accordance with the magnitude of the image density gradient vector 
S v and the distances from the line segment to the sampling points S A , S B , Sc. and Sp. The correction is carried out 
in the manner described below. 

The coordinate values of a sampling point shown in Figure 1 5 are represented by (u, v), and the interpolation coef- 
ficient corresponding to the sampling point having the coordinates (u, v) is represented by a^ ^ Also, the coordinate val- 
ues of the interpolation point S* are represented by (dx, dy), and the image density gradient vector Sv is represented by 
(Sx, Sy). In such cases, a corrected interpolation coefficient a' u v is calculated with Formula (41) shown below. 

a 'u l v sa u l v / ( k ' f (Sv.t)+1] (41) 

wherein k represents a fixed number, and f(S v t) is the correction term and represents (image density gradient 
vector S v )x{distance from the perpendicularly intersecting line segment L v to coordinates (u. v) }. 

Specifically, the calculation with Formula (41) is carried out in the manner described below. 

Firstly, the correction term calculating means 43' calculates the magnitude |S V | of the image density gradient vector 
(Sx, Sy) having been calculated by the image density gradient vector and distance calculating means 42'. The calcula- 
tion is made with Formula (42) shown below. 

|S v |=(Sx 2 +Sy 2 ) 1/2 (42) 

Thereafter, a calculation is made to find the distance t between the line segment Ly, which passes through the inter- 
polation point S' having the coordinates (dx. dy) and intersects perpendicularly to the image density gradient vector S v , 
and each sampling point having the coordinates (u. v). The calculation is made with Formula (43) shown below. 

t=|Sx(u-dx)+Sy(v-dy)|/(Sx 2 +Sy 2 ) 1/2 (43) 

Therefore, the correction term ffSv, t) is represented by Formula (44) shown below. 

f(S v? t)=|Sx(u-dx)+Sy(v-dy)| (44) 

In the correction means 44', the interpolation coefficient is corrected by using the correction term f{Sv. t), which has 
been calculated by the correction term calculating means 43'. Specifically, Formula (44) is substituted into Formula (41), 
and Formula (41 ') shown below is thereby obtained. 

a'u.v^u.v^ ■ |Sx(u-dx)+Sy(v-dy)|+1} (4r) 

The processing for correcting the interpolation coefficient a^ is carried out for the four original picture elements 
S A . S 3 , S c . and Sq located in the vicinity of the interpolation point S\ and four corrected interpolation coefficients a' u v 
are thereby obtained. The corrected interpolation coefficients a' u v having thus been obtained are normalized, and ulti- 
mate interpolation coefficients {a^yfla'^ are thereby obtained. 

The ultimate interpolation coefficients (a^v/Ea^) having thus been obtained are corrected such that the value of the 
interpolation coefficient may become smaller than the original interpolation coefficient as the inclination of the image 
density gradient vector Sv at the interpolation picture element S\ for which the interpolated image signal component is 
to be calculated, becomes large and as the distance from the line segment, which intersects perpendicularly to the 
image density gradient vector S v becomes large. 



28 



EP0 798 664 A2 



The information representing the ultimately obtained interpolation coefficients (a' u iV /Ea'jj) is fed into the operation 
processing means 45*. The operation processing means 45' calculates the interpolated image signal component S' 
from the ultimately obtained interpolation coefficients a' A , a' B , a' c . and a* D tor each interpolation point and the corre- 
sponding original image signal components S A . S B . S c , and Si> The calculation is made with Formula (45) shown 
below. 

S =a' A • S A +a' B • S B +a* c • S c +a' D • S D (45) 

In the interpolation image signal S' comprising the interpolated image signal components S'. which have been 
obtained in this manner, the effects of the original image signal components representing the original picture elements 
located at positions remote from the image edge portion, at which the image density gradient vector S v is comparatively 
large, in the original image have been reduced. Therefore, in the obtained interpolation image, a step-like pattern does 
not occur even at the image edge portion extending along the oblique direction. Accordingly, by the image reproducing 
means 60. an interpolation image can be reproduced which has a smooth and sharp image edge portion. 

In cases where it has been judged by the edge presence or absence judging means 31 that the image edge portion 
is absent, the processing described below is carried out. 

Firstly, the primary image signal Sorg is fed from the storage means 10 into the interpolating operation means 54* 
of the second interpolating operation means 50'. 

In the second interpolating operation means 50*. the B spline interpolation coefficient storing means 5V and the 
cubic spline interpolation coefficient storing means 52* set the values of t in the respective interpolation coefficients in 
accordance with the image size enlargement scale factor having been inputted from the input means 21. For example, 
in cases where an image size enlargement scale factor of 2 is inputted, values of 0.5 and 1 .0 are set as the values of t 
In cases where an image size enlargement scale factor of 4 is inputted, values of 0.25, 0.5. 0.75, and 1 .0 are set as the 

values of t. In cases where an image size enlargement scale factor of 10 is inputted, values of 0.1 , 0.2 1 .0 are set 

as the values of t. Information representing the B spline interpolation coefficients and the cubic spline interpolation coef- 
ficients, which are for each of the thus set values oft, is fed into the interpolation coefficient operation means 53'. 

Also, information representing a value of the parameter (i.e.. the factor) a corresponding to a level of sharpness 
desired for the secondary image is inputted from the sharpness instruction input means 51 into the interpolation coef- 
ficient operation means 53*. 

The information representing the value of the parameter a may be directly inputted by the operator. Alternatively, 
information representing a response R, which corresponds to the level of sharpness desired for the interpolation image, 
may be inputted by the operator, and a look-up table for converting the response R into the corresponding parameter a 
may be provided. For such purposes, for example, the constitution of an input means described with reference to Figure 
3 in EP 753 828 A2, which has been filed by the applicant, may be employed. In cases where the sharpness is specified 
in accordance with the response R. the extent of the change in the sharpness can be grasped as an actual feeling. 

The information representing the parameter a, which has been inputted directly or has been calculated from the 
inputted response R. is fed into the interpolation coefficient operation means 53'. 

The interpolation coefficient operation means 53' calculates the new interpolation coefficients a k . 1( a k . a^. and 
ak +2 for each of the values of t according to the value of the parameter a from the received B spline interpolation coef- 
ficients and the received cubic spline interpolation coefficients, which are for each of the values of t. and the parameter 
a. The calculations are carried out with Formulas (46), (47), (48). and (49). 

The information representing the calculated new interpolation coefficients a^, a*, a k+1 , and a^ is fed into the 
interpolating operation means 54'. 

The interpolating operation means 54* calculates the value of the interpolated image signal component S\ which 
corresponds to the interpolation point S\ with Formula (1), which is stored therein and serves as the operation formula 
with the third-order spline interpolating function, in accordance with the interpolation coefficients a k .-| , a k , , and a^, 
which have been received from the interpolation coefficient operation means 53'. and the received original image signal 
components S k . 1f Sk. S^. and S^. 

The thus obtained interpolation image signal S* containing the interpolated image signal components, which corre- 
spond to all interpolation points, is fed into the image reproducing means 60. The image reproducing means 60 repro- 
duces a visible image from the received interpolation image signal S\ The sharpness of the reproduced visible image 
can be adjusted easily by merely changing the value of the inputted parameter a. In cases where a negative value less 
than 0 is inputted as the value of the parameter a. an image having a sharpness higher than the sharpness of the sec- 
ondary image, which is obtained with the ordinary cubic spline interpolating operation, can be obtained. In cases where 
a value larger than 1 is inputted as the value of the parameter a. a smooth image having a sharpness lower than the 
sharpness of the secondary image, which is obtained with the ordinary B spline interpolating operation, can be 
obtained. Also, in cases where the parameter a is set to be equal to a value larger than 0 and smaller than 1 , an image 
having a sharpness, which is intermediate between the sharpness of the secondary image obtained with the cubic 
spline interpolating operation and the sharpness of the secondary image obtained with the B spline interpolating oper- 
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ation, can be obtained. 

In the second interpolating operation means 50' employed in this embodiment, the sharpness of the interpolation 
image is rendered variable by the combination of the B spline interpolating operation and the cubic spline interpolating 
operation. However, the interpolating operation method for an image signal in accordance with the present invention is 
not limited to the combination of the B spline interpolating operation and the cubic spline interpolating operation, and 
various combinations of two interpolating functions yielding different levels of sharpness may be employed. For exam- 
ple, various interpolating operation functions, such as the B spline interpolating operation function, the cubic spline 
interpolating operation function, a linear interpolating function, and a Lagrangean interpolating operation function, may 
be used, and an arbitrary combination of two of these functions may be employed. 

Also, in the first interpolating operation means 40* employed in this embodiment, the interpolation coefficient is cor- 
rected in accordance with Formula (41 ). Alternatively, the interpolation coefficient may be corrected in accordance with 
Formula (50) shown below. 

a' UiVB a UiV /(F(S v , t)} (50) 

wherein F(S V t) is a function as illustrated in Figure 1 6. the value of which increases monotonously as the value of f (S v . 
t) increases. 

Further, in the first interpolating operation means 40' employed in this embodiment, the interpolating operation is 
carried out in accordance with the cubic spline interpolating operation. However, the interpolating operation method for 
an image signal in accordance with the present invention is not limited to the cubic spline interpolating operation, and 
the interpolating operation may be carried out in accordance with the B spline interpolating operation. In the B spline 
interpolating operation, the spline interpolating function need not pass through the original sampling points (picture ele- 
ments), and it is necessary that the first-order differential coefficient and the second-order differential coefficient of the 
spline interpolating function are continuous between adjacent sections. Under such conditions, the interpolation coeffi- 
cients fcv-, , tv, b^., . and b^ in the B spline interpolating operation, which correspond to the original image signal com- 
ponents S^, Sk. Sk +1 , and S k+2 . may be calculated with the operation as described above. 

For the original image signal components Sk. v S*. S k+1 . and S^. it is also possible to employ the interpolation 
coefficients, which are obtained by weighting the B spline interpolation coefficients and the cubic spline interpolation 
coefficients in accordance with Formulas (46), (47). (48), and (49) shown above. Also, the interpolating operation may 
be carried out with the linear interpolation. 

In the image reproducing systems provided with the aforesaid embodiments, the interpolating operation apparatus 
30 or the interpolating operation apparatus 30' utilizes the primary image signal having been previously stored in the 
storage means 10. However, the interpolating operation apparatus in accordance with the present invention is not lim- 
ited to these embodiments. For example, an image signal representing an image, which has been detected by using a 
predetermined image read-out apparatus, may be directly fed from the image read-out apparatus into the interpolating 
operation apparatus 30 or the interpolating operation apparatus 30'. 

Claims 

1 . An interpolating operation method for an image signal, wherein an interpolated image signal component corre- 
sponding to an interpolation point is calculated from original image signal components of an original image signal 
representing an original image, which represent a plurality of sampling points arrayed at predetermined intervals 
and in a lattice-like form, the method comprising the steps of: 

i) making a judgment as to whether the interpolation point belongs to an image edge portion, at which the 
change in the original image signal is sharp, or belongs to a flat portion, at which the change in the original 
image signal is unsharp, and 

ii) changing interpolating operation processes, one of which is to be employed for the interpolation point, over 
to each other in accordance with the results of the judgment. 

2. A method as defined in Claim 1 wherein the interpolating operation process, which is employed in cases where, as 
a result of said judgment, it has been judged that the interpolation point belongs to the image edge portion, is an 
interpolating operation process comprising the steps of: 

a) specifying the direction, along which the image edge portion extends, with respect to the array directions of 
the sampling points in a unit lattice, and 

b) changing selection processes for selecting the original image signal components, from which the interpo- 
lated image signal component corresponding to the interpolation point is to be calculated, over to each other 
in accordance with said direction, along which the image edge portion extends. 
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3. A method as defined in Claim 2 wherein said direction, along which the image edge portion extends, is specified by: 

grouping each of two sets of sampling points, each set being constituted of two sampling points, which are 
located at two diagonal positions facing each other in the unit lattice, that contains the interpolation point 
5 therein, 

calculating the difference between the original image signal components representing the two sampling points, 
which constitute each of the two sets of sampling points, and 

comparing the differences, which have been calculated for the two sets of sampling points, with each other. 

10 4. A method as defined in Claim 2 wherein said direction, along which the image edge portion extends, is specified by: 

grouping each of two sets of sampling points, each set being constituted ol two sampling points, which are 
located at two diagonal positions facing each other in the unit lattice, that contains the interpolation point 
therein, 

75 calculating the difference between the original image signal components representing the two sampling points, 

which constitute each of the two sets of sampling points, 

comparing the differences, which have been calculated for the two sets of sampling points, with each other, and 
carrying out an operation in accordance with the original image signal components representing the sampling 
points, which are located around the unit lattice, that contains the interpolation point therein. 

20 

5. A method as defined in Claim. 2 wherein said direction, along which the image edge portion extends, is specified by: 

calculating an image density gradient vector with respect to each of the two array directions of the sampling 
points in the unit lattice, the calculation being made from the original image signal components representing 
25 four sampling points, which constitute the unit lattice, that contains the interpolation point therein, and 

making a judgment from the magnitude and the product of the two image density gradient vectors, which have 
been calculated with respect to the two array directions of the sampling points in the unit lattice. 

6. A method as defined in Claim 2 wherein said selection processes for selecting the original image signal compo- 
30 nents comprise: 

(i) a selection process, which is employed in cases where it has been specified that the image edge portion 
extends along an oblique direction with respect to the array directions of the sampling points in the unit lattice, 
the selection process comprising the steps of: 

35 

dividing the unit lattice into two triangular regions with the image edge portion serving as the boundary 
therebetween, 

selecting a triangular region, which contains the interpolation point therein, from the two triangular regions, 
" and 

40 selecting the original image signal components, which represent the three sampling points, that constitute 

the triangular region containing the interpolation point therein, and 

(ii) a selection process, which is employed in cases where it has been specified that the image edge portion 
extends along a direction parallel to one of the array directions of the sampling points in the unit lattice, the 

45 selection process comprising selecting the original image signal components, which represent the four sam- 

pling points, that constitute the unit lattice containing the interpolation point therein. 

7. A method as defined in Claim 1 wherein the interpolating operation process, which is employed in cases where, as 
a result of said judgment, it has been judged that the interpolation point belongs to the image edge portion, is an 

so interpolating operation process comprising the steps of: 

a) calculating each of interpolation coefficients, by which the corresponding one of the original image signal 
components is to be multiplied, from the original image signal components, which represent a plurality of the 
sampling points located in the vicinity of the interpolation point. 
55 °) calculating an image density gradient vector at the interpolation point on the original image, which is repre- 

sented by the original image signal components, 

c) calculating the distance between a line segment, which intersects perpendicularly to said image density gra- 
dient vector, and each of the sampling points located in the vicinity of the interpolation point, 

d) correcting the interpolation coefficients such that the interpolation coefficient, by which the corresponding 
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original image signal component is to be multiplied, may become small for a sampling point, for which said 
image density gradient vector and/or said distance is comparatively large, and 

e) multiplying the original image signal component by the corresponding corrected interpolation coefficient. 

A method as defined in Claim 1 wherein the interpolating operation process, which is employed in cases where, as 
a result of said judgment, it has been judged that the interpolation point belongs to the flat portion, is an interpolat- 
ing operation process, with which the sharpness of the flat portion is rendered variable. 

A method as defined in Claim 8 wherein said interpolating operation process, with which the sharpness of the flat 
portion is rendered variable, is a spline interpolating operation process. 

10. A method as defined in Claim 9 wherein said spline interpolating operation process is an interpolating operation 
process for obtaining an interpolated image signal component with Formula (1). 

' 5 Y P = a k-i Y k-i +a k Y k+a m Y k + i +» k +2 Y k + z ( i ) 

in which Y k . 1( Y k , Y k+1 , and Y k+2 represent the original image signal components representing sampling points 
serving as picture elements . X*. X k+1 , and X k+2 in the original image. Y p represents the interpolated image sig- 
nal component corresponding to an interpolation point X p located between the picture elements X k and X^, and 
20 a*.-, , a*, a^., , and a^ represent the interpolation coefficients, 
the process comprising the steps of: 

a) calculating the interpolation coefficients a^, a^ a k+1 . and a^ respectively corresponding to the original 
image signal components Y^, Y k , Y k+1 , and Y k+2 such that, in cases where the original image signal compo- 
nents representing the two picture elements X ko and X k located before the interpolation point Xp. which is 
located between the picture elements X k and X k+1 in the original image, are represented by Y k . n and Y k , the 
original image signal components representing the two picture elements Xk +1 and located after the inter- 
polation point Xp are represented by Y k+1 and Y k+2 . a third-order spline interpolating function between the pic- 
ture elements X* and X k+1 is represented by f k , a third-order spline interpolating function between the picture 
30 elements and X^ is represented by f k _<| , and a third-order spline interpolating function between the picture 

elements X k+1 and X^ is represented by f k+1 : 

® the spline interpolating function f k at the picture elements X k and X k+1 may satisfy the original image 
signal components Y k and Y k+1 , as represented by Formulas (2) and (3): 

fk(X k )=Y k (2) 

f k( X k*i)= Y k + i (3) 

© the first-order differential coefficient of the spline interpolating function f k at the picture element X|< may 
coincide with the first-order differential coefficient of the spline interpolating function f k _., at the picture ele- 
ment X k , as represented by Formula (4): 

V(X k )=W(X k ) (4) 

® the first-order differential coefficient of the spline interpolating function f k at the picture element X,< +1 
may coincide with the first-order differential coefficient of the spline interpolating function f k+1 at the picture 
element X^, as represented by Formula (5): 

50 V(Xk + i>=W(XK+i) (5) 

® the first-order differential coefficient of the spline interpolating function f k at the picture element X* may 
have an inclination of an arbitrary parameter a with respect to the gradient of the original image signal 
components Y k . 1 and Y k+1 representing the picture elements X k .t and X k+1 , which are located before and 
55 after the picture element X*. as represented by Formula (6). the arbitrary parameter a being selected pre- 

viously and determining the sharpness of a secondary image represented by the interpolation image sig- 
nal obtained from the interpolating operation, 

MXk^Y^-Y^MX^-X^) (6 ) 
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and 

© the first-order differential coefficient of the spline interpolating function f k at the picture element X k+1 
may have an inclination of said parameter a with respect to the gradient of the original image signal com- 
ponents Y k and Y k+2 representing the picture elements X k and X^, which are located before and after the 
picture element X k+1 , as represented by Formula (7): 

f k '(X k+1 )=a(Y k+2 -Y k )/(X h+2 -X k ) (7) 

and 

b) calculating the interpolated image signal component Y p corresponding to the interpolation point X p in 
accordance with the calculated interpolation coefficients a k . 1( a^ a^, and a k+2 . and the original image signal 
components Y k-1 , Y k . Y k+1 , and Y k+2 . 

11. A method as defined in Claim 10 wherein the calculated interpolation coefficients a k . 1f a k , a k+v and a^ +2 ar ^ rep- 
resented respectively by Formulas (8). (9). (10), and (1 1): 

a k . r -«t(M) 2 (6) 

a k =(2-a/2)t 3 -(3-a/2)t 2 +1 (9) 

a k+1 =(a/2-2)t 3 +(3-a)t 2 +(a/2)t (10) 

a k+2 =(a/2)t 2 (t-1) (11) 

in which t; where 0st<1. represents the position of the interpolation point Xp. the position being taken with respect 
to the picture element X k , that serves as a reference position, and in the direction heading toward the picture ele- 
ment X k+1 , the lattice interval of the original image signal components being set to be equal to 1 . 

12. A method as defined in Claim 9 wherein said spline interpolating operation process is an interpolating operation 
process for obtaining an interpolated image signal component with Formula (1), 

Yp^h-iYk-i+akYk+ak+i+Y^i+a^Yk^ (1) 

in which Y k ; 1t Y k , Y k+1 , and Y k+2 represent the original image signal components representing sampling points 
serving as picture elements X^, X k , X k+1 , and X k+2 in the original image, Y p represents the interpolated image sig- 
nal component corresponding to an interpolation point Xp located between the picture elements X k and X k+1 , and 
B k .^ t a|<. a k+1 , and a k+2 represent the interpolation coefficients, 
the process comprising the steps of: 

a) calculating the interpolation coefficients a k . 1( a^ a k+1 , and a^ respectively corresponding to the original 
image signal components Y k . 1f Y k . Y k+1 , and Y k+2 such that, in cases where the original image signal compo- 
nents representing the two picture elements X^ and ^ located before the interpolation point Xp, which is 
located between the picture elements X k and X k+1 in the original image, are represented by Y k . 1 and X k , the 
original image signal components representing the two picture elements X k+1 and X^ located after the inter- 
polation point Xp are represented by X k+1 and Y k+2f a third-order spline interpolating function between the pic- 
ture elements X|< and X k+1 is represented by f k , a third-order spline interpolating function between the picture 
elements X k _, and X k is represented by f k . 1t and a third-order spline interpolating function between the picture 
elements X k+1 and X k+2 is represented by f k+1 : 

® the spline interpolating function f k at the picture elements X k and X k+1 may slightly deviate from the 
original image signal components Y k and Y k+1 in accordance with an arbitrary parameter p, as repre- 
sented by Formulas (12) and (13), the arbitrary parameter p being selected previously and determining the 
sharpness of a secondary image represented by the interpolation image signal obtained from the interpo- 
lating operation. 

f k (X k )=-0.5pY k . 1+ (1 + P)Y k -0.5(JY k+1 (12) 
f k (X k+1 )=-0.5pY k+ (1 +P)Y k+1 -0.5PY k+2 (13) 
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@ the first-order differential coefficient of the spline interpolating function f k at the picture element X k may 
coincide with the first-order differential coefficient of the spline interpolating function f^ at the picture ele- 
ment X^ as represented by Formula (4): 

£K*<X k )=f k V(X k ) (4) 

® the first-order differential coefficient of the spline interpolating function f k at the picture element X k+1 
may coincide with the first-order differential coefficient of the spline interpolating function f k+1 at the picture 
element X^.,, as represented by Formula (5): 

V(Xk + i)=fXk + i'(Xk + i) (5) 

® the first-order differential coefficient of the spline interpolating function f k at the picture element X k may 
coincide with the gradient of the original image signal components Y kM and Y k+1 representing the picture 
elements X k . 1 and X k+1 , which are located before and after the picture element X k , as represented by For- 
mula (14): 

fh'(X k HY k+1 -Y k . 1 )/(X k+1 -X k . 1 ) (14 ) 

and 

© the first-order differential coefficient of the spline interpolating function f k at the picture element X k+1 
may coincide with the gradient of the original image signal components Y k and Y k+2 representing the pic- 
ture elements X* and X^. which are located before and after the picture element X k+1 . as represented by 
Formula (15): 

f k (X k+1 )=(Y k+2 -Y k )/(X k+2 -X k ) (15 ) 

and 

b) calculating the interpolated image signal component Y p corresponding to the interpolation point Xp in 
accordance with the calculated interpolation coefficients a^. ci*, a*^, and a k+2 . and the original image signal 
components Y k . 1t Y k , Y k+1 , and Y k+2 . 

13. A method as defined in Claim 12 wherein the calculated interpolation coefficients 1( a^ a^. and aw, are rep- 
resentedrespectivelyby Formulas (16) f (17), (18), and (19): 

a^HP+lfc^+^pfc+in 2 -(1/2)t-p^ (16 ) 

a k =3(p+1/2)t 3 -(9p/2+5/2)t 2 +P+1 ( 17 ) 

a k+1 =-3(p+1/2)t 3 +(9p/2+2)t 2 +(1/2)t-p/2 ( 18) 

a k+2 =(p+1/2)t 3 -(3p/2+1/2)t 2 (19) 

in which t. where 0<t<1 , represents the position of the interpolation point Xp. the position being taken with respect 
to the picture element Xk, that serves as a reference position, and in the direction heading toward the picture ele- 
ment X k+1 . the lattice interval of the original image signal components being set to be equal to 1. 

14. A method as defined in Claim 9 wherein said spline interpolating operation process is an interpolating operation 
process for obtaining an interpolated image signal component with Formula (1). 

Y P =a k-1 Y h-1 +a k Y k + aK + i +Y k + i+a k + 2 Y k +2 (1 ) 

in which Y k . 1f Y k , Y k+1f and Y k+2 represent the original image signal components representing sampling points 
serving as picture elements X^ . X,,. X k+1 . and X k+2 in the original image. Y p represents the interpolated image sig- 
nal component corresponding to an interpolation point X p located between the picture elements X k and X k+1 . and 
. ak. &k+i . and a^g represent the interpolation coefficients, 
the process comprising the steps of: 
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a) calculating the interpolation coefficients a k . 1t a^ a^, and a k+2 respectively .corresponding to the original 
image signal components Y k . 1t Y k , Y k+1 , and Y k+2 such that, in cases where the original image signal compo- 
nents representing the two picture elements X M and Xj^ located before the interpolation point X p , which is 
located between the picture elements \ and X^ in the original image, are represented by Y^ and Y k , the 
original image signal components representing the two picture elements X k+1 and X k+2 located after the inter- 
polation point Xp are represented by Y k+1 and Y k+2 , a third-order spline interpolating function between the pic- 
ture elements X k and X k+1 is represented by f k , a third-order spline interpolating function between the picture 
elements X^ and X k is represented by f^. and a third-order spline interpolating function between the picture 
elements X k+1 and X k+2 is represented by f k+1 : 

® the spline interpolating function f k at the picture elements Xk and X k+1 may satisfy the original image 
signal components Y k and Y k+1f as represented by Formulas (2) and (3): 

*k(X k >=Y k (2) 

* k( X k+1 ) C Y k+1 (3) 

© the first-order differential coefficient of the spline interpolating function f k at the picture element X k may 
coincide with the first-order differential coefficient of the spline interpolating function f k . n at the picture ele- 
ment X^ as represented by Formula (4): 

VP<k>=W(Xk> (4) 

® the first-order differential coefficient of the spline interpolating function f k at the picture element X|< +1 
may coincide with the first-order differential coefficient of the spline interpolating function f k+1 , at the pic- 
ture element X k+1 . as represented by Formula (5): 

V(X k+1 )=W(X k+1 ) (5) 

@ the first-order differential coefficient of the spline interpolating function f k at the picture element X k may 
have an inclination of an arbitrary parameter a with respect to the gradient of the original image signal 
components Y k-1 and Y k+1 representing the picture elements X k-1 and X k+1 , which are located before and 
after the picture element X k , as represented by Formula (6), the arbitrary parameter a being selected pre- 
viously and determining the sharpness of a secondary image represented by the interpolation image sig- 
nal obtained from the interpolating operation, 

fkfX^Y^-Y^VCX^-X^) (6) 

and 

© the first-order differential coefficient of the spline interpolating function f k at the picture element X k+1 
may have an inclination of said parameter a with respect to the gradient of the original image signal com- 
ponents Y k and Y k+2 representing the picture elements X k and X k + 2 , which are located before and after the 
picture element X k+1 , as represented by Formula (7): 

^k'(X k+1 )=a(Y k+2 -Y k )/(X k+2 -X k ) (7) 

b) calculating interpolation coefficients b^ , b^, b^, and b|< +2 respectively corresponding to the original image 
signal components Y k . 1( Y k . Y k+1 , and Y k+2 such that: 

© the spline interpolating function f k at the picture elements X k and X k+1 may slightly deviate from the 
original image signal components Y k and Y k+1 in accordance with an arbitrary parameter p f as repre- 
sented by Formulas (12), and (13), the arbitrary parameter p being selected previously and determining the 
sharpness of the secondary image represented by the interpolation image signal obtained from the inter- 
polating operation, 

f k (X k )=-0.5pY k . 1+ (1 + p)Y k -0.5pY k+1 (12 ) 
* k(* k+1 )-0.5pY k+ (1 + P)Y k+1 -0.5PY k+2 (13) 
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© the first-order differential coefficient of the spline interpolating function f k at the picture element X k may 
coincide with the first-order differential coefficient of the spline interpolating function f M at the picture ele- 
ment X k , as represented by Formula (4): 

iK , (X k )=f K .i'(X k ) (4) 

® the first-order differential coefficient of the spline interpolating function f k at the picture element Xj< +1 
may coincide with the first-order differential coefficient of the spline interpolating function f k+1 at the picture 
element X k+1 , as represented by Formula (5): 

f k '(X k+1 )=f k+1 XX k+1 ) (5 ) 

® the first-order differential coefficient of the spline interpolating function f k at the picture element X k may 
coincide with the gradient of the original image signal components Y M and Y k+1 representing the picture 
elements X^., and X k+1 , which are located before and after the picture element X k( as represented by For- 
mula (14): 

VCXkMY^rY^wx^oc^) ( i 4 ) 

and 

© the first-order differential coefficient of the spline interpolating function f k at the picture element X k+1 
may coincide with the gradient of the original image signal components Y k and Y k42 representing the pic- 
ture elements X* and X^, which are located before and after the picture element X k+1 . as represented by 
Formula (15): 

f k '(X k ^)=(X k+2 -Y k )/(X k+2 -X K ) (15 ) 

c) calculating a mean value of the set of the interpolation coefficients a^-, and b^ . a mean value of the set of 
the interpolation coefficients a k and t^, a mean value of the set of the interpolation coefficients a»< +1 and bk +1 , 
and a mean value of the set of the interpolation coefficients and b^ 2 , which sets respectively correspond 
to the original image signal components Y k . 1f Y k , Y k+1 , and Y k+2 , the calculated mean values being taken as 
the values of new interpolation coefficients a^., , a^ a^, and a k+2 , and 

d) calculating the interpolated image signal component Y p corresponding to the interpolation point Xp in 
accordance with the calculated new interpolation coefficients a^, a* a^, and a*^. and the original image 
signal components Y M . Y k , Y k+1 . and Y k+2 . 

A method as defined in Claim 14 wherein the calculated new interpolation coefficients a k . 1t a* a k+1 , and a k+2 . 
which represent the mean values, are represented respectively by Formulas (20). (21), (22), and (23): 

a k . 1 =-{(a+2p+1)/4]t 3 +{(2a+3p+2)/4)t 2 -{(a+1)/4}t-p/4 (20) 

a k ={(-a+6p+7)/4)t 3 +{(a-9p-1 1)/4}t 2 +p/2+1 (21) 

a k + i =K« "6 P*7)/4}t 3 +{(-2u+9p+1 0)/4}t 2 +{(u+1 )/4}t- p/4 (22) 

a k + 2=«*+2p+1)/4)t 3 -{(a+3p+1)/4)t 2 (23) 

in which t, where 0<t<1, represents the position of the interpolation point Xp, the position being taken with respect 
to the picture element \. that serves as a reference position, and in the direction heading toward the picture ele- 
ment X k+1 , the lattice interval of the original image signal components being set to be equal to 1 . 

A method as defined in Claim 8 wherein said interpolating operation process, with which the sharpness of the flat 
portion is rendered variable, is an interpolating operation process, comprising the steps of: 

linearly combining interpolation coefficients Bij and Cij. which correspond to each other and are set for each of 
the original image signal components Yij, in two different interpolating functions f and g for obtaining two inter- 
polation images having different levels of sharpness, which functions are represented by Formulas (24) and 
(25). said linear combination being carried out with Formula (26) by use of a variable factor a, where a is set 
to be one of all real numbers, a new interpolation coefficient Aij being obtained from said linear combination, 



36 



EP 0 798 664 A2 



and 

carrying out an interpolating operation on the original image signal components Yij by using an interpolating 
function h having the new interpolation coefficient Aij, which function is represented by Formula (27): 

f=!Bij • Yij (24) 

g=£C0-Yij (25) 

Aij=(1-a)Bij+aCij (26) 

h=IAij • Yij (27) 

in which i=1. 2 j=1 , 2 and 

a represents one of all real numbers. 



17. A method as defined in Claim 16 wherein one of said two different interpolating functions f and g for obtaining two 
interpolation images having different levels of sharpness is a cubic spline interpolating operation function, and the 
other is a B spline interpolating operation function. 

18. An interpolating operation apparatus for an image signal, wherein an interpolated image signal component corre- 
sponding to an interpolation point is calculated from original image signal components of an original image signal 
representing an original image, which represent a plurality of sampling points arrayed at predetermined intervals 
and in a lattice-like form, the apparatus comprising: 

i) an edge presence or absence judging means for making a judgment as to whether the interpolation point 
belongs to an image edge portion, at which the change in the original image signal is sharp, or belongs to a 
flat portion, at which the change in the original image signal is unsharp. 

ii) a first interpolating operation means for calculating an interpolated image signal component corresponding 
to an interpolation point, which belongs to the image edge portion, 

iii) a second interpolating operation means for calculating an interpolated image signal component correspond- 
ing to an interpolation point which belongs to the flat portion, and 

iv) an operation change-over means for changing said first interpolating operation means and said second 
interpolating operation means over to each other, such that said first interpolating operation means may be uti- 
lized in cases where, as a result of said judgment made by said edge presence or absence judging means, it 
has been judged that the interpolation point belongs to the image edge portion, and such that said second 
interpolating operation means may be utilized in cases where, as a result of said judgment made by said edge 
presence or absence judging means, it has been judged that the interpolation point belongs to the flat portion. 

19. An apparatus as defined in Claim 18 wherein said first interpolating operation means comprises: 

a) an edge extending direction specifying means for specifying the direction, along which the image edge por- 
tion extends, with respect to the array directions of the sampling points in a unit lattice, 

b) a first operation means comprising: 



a region dividing means for dividing the unit lattice into two triangular regions with the image edge portion 
serving as the boundary therebetween, said image edge portion extending along an oblique direction with 
respect to the array directions of the sampling points in the unit lattice, 

a region selecting means for selecting a triangular region, which contains the interpolation point therein, 
from the two triangular regions, and 

an operation means for calculating the interpolated image signal component corresponding to the interpo- 
lation point, the calculation being made from the original image signal components, which represent the 
three sampling points, that constitute the triangular region containing the interpolation point therein. 

c) a second operation means for calculating the interpolated image signal component corresponding to the 
interpolation point, the calculation being made from the original image signal components, which represent the 
four sampling points, that constitute the unit lattice containing the interpolation point therein, and 

d) an operation selecting means for: 

selecting said first operation means in cases where, as a result of said specifying carried out by said edge 



37 



EP 0 798 664 A2 



extending direction specifying means, it has been specified that the image edge portion extends along an 
oblique direction with respect to the array directions of the sampling points in the unit lattice, and 
selecting said second operation means in cases where, as a result of said specifying carried out by said 
edge extending direction specifying means, it has been specified that the image edge portion extends 
along a direction parallel to one of the array directions of the sampling points in the unit lattice. 

20. An apparatus as defined in Claim 1 9 wherein said edge extending direction specifying means specifies said direc- 
tion, along which the image edge portion extends, by: 

grouping each of two sets of sampling points, each set being constituted of two sampling points, which are 
located at two diagonal positions facing each other in the unit lattice, that contains the interpolation point 
therein. 

calculating the difference between the original image signal components representing the two sampling points, 
which constitute each of the two sets of sampling points, and 

comparing the differences, which have been calculated for the two sets of sampling points, with each other. 

21. An apparatus as defined in Claim 19 wherein said edge extending direction specifying means specif ies said direc- 
tion, along which the image edge portion extends, by: 

grouping each of two sets of sampling points, each set being constituted of two sampling points, which are 
located at two diagonal positions facing each other in the unit lattice, that contains the interpolation point 
therein. 

calculating the difference between the original image signal components representing the two sampling points, 
which constitute each of the two sets of sampling points. 

comparing the differences, which have been calculated for the two sets of sampling points, with each other, and 
carrying out an operation in accordance with the original image signal components representing the sampling 
points, which are located around the unit lattice, that contains the interpolation point therein. 

22. An apparatus as defined in Claim 19 wherein said edge extending direction specifying means specifies said direc- 
tion, along which the image edge portion extends, by: 

calculating an image density gradient vector with respect to each of the two array directions of the sampling 
points in the unit lattice, the calculation being made from the original image signal components representing 
four sampling points, which constitute the unit lattice, that contains the interpolation point therein, and 
making a judgment from the magnitude and the product of the two image density gradient vectors, which have 
been calculated with respect to the two array directions of the sampling points in the unit lattice. 

23. An apparatus as defined in Claim 18 wherein said first interpolating operation means comprises: 

a) an interpolation coefficient calculating means for calculating each of interpolation coefficients, by which the 
corresponding one of the original image signal components is to be multiplied, from the original image signal 
components, which represent a plurality of the sampling points located in the vicinity of the interpolation point. 

b) an image density gradient vector calculating means for calculating an image density gradient vector at the 
interpolation point on the original image, which is represented by the original image signal components, 

c) a distance calculating means for calculating the distance between a line segment which intersects perpen- 
dicularly to said image density gradient vector, and each of the sampling points located in the vicinity of the 
interpolation point. 

d) a correction means for correcting the interpolation coefficients such that the interpolation coefficient, by 
which the corresponding original image signal component is to be multiplied, may become small for a sampling 
point, for which said image density gradient vector and/or said distance is comparatively large, and 

e) an operation processing means for multiplying the original image signal component by the corresponding 
interpolation coefficient, which has been corrected by said correction means. 

24. An apparatus as defined in Claim 18 wherein said second interpolating operation means comprises: 

an input means for inputting an instruction concerning the alteration of sharpness of the flat portion from the 
exterior, and 

an interpolating operation means, with which the sharpness of the fiat portion is capable of being altered in 
accordance with the instruction inputted from said input means. 
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25. An apparatus as defined in Claim 24 wherein said interpolating operation means, with which the sharpness of the 
flat portion is capable of being altered, is a spline interpolating operation means. 

26. An apparatus as defined in Claim 25 wherein said spline interpolating operation means is an interpolating operation 
means for obtaining an interpolated image signal component with Formula (1). 

Y p=3 k- 1 Y K.i +3 k Y k +a k+1 ^ k+1 +3 k+2 ^ k+2 ( 1 ) 

in which Y k _., , Y k , Y k+1 , and Y k+2 represent the original image signal components representing picture elements X k . 
1. X k , X k+V and X k+2 in the original image, Y p represents the interpolated image signal component corresponding 
to an interpolation point X p located between the picture elements X k and X k+1t and a k . 1f a^ a k+1 , and a k+2 repre- 
sent the interpolation coefficients, 

the spline interpolating operation means comprising: 

1) a storage means for storing information representing the interpolation coefficients a k _ v a^ a^. and a^, 
which respectively correspond to the original image signal components Y k . 1t Y k , Y k+1 , and Y k+2 representing 
the picture elements X k . 1t X^ X k+ i , and X^ in the original image, and which are set to be respectively repre- 
sented by Formulas (8), (9), (10). and (1 1): 

a M ^ofi)t(t-l) 2 (8) 

a k 42-a/2)t 3 -(3-a/2)t 2 +1 (9) 

a h ^=(a/2-2)t 3 +(3-a)t 2 +(a/2)t (10) 

a k+2 =(a/2)t 2 (M) (11) 

in which a represents the parameter determining the sharpness of a secondary image represented by the 
interpolation image signal obtained from the interpolating operation, and t. where 0£t<1 , represents the posi- 
tion of the interpolation point Xp, the position being taken with respect to the picture element X k , that serves as 
a reference position, and in the direction heading toward the picture element X k+1 , the lattice interval of the 
original image signal components being set to be equal to 1 , 

2) an input means for inputting the arbitrary parameter a, which determines the sharpness of the secondary 
image reproduced from the interpolation image signal obtained from the interpolating operation, 

3) an interpolation coefficient operation means for calculating the interpolation coefficients a^, a^ a k+1 , and 
a^ ' n accordance with the parameter a. the calculation being carried out from the interpolation coefficients, 
which are stored in said storage means, and the parameter a inputted from said input means, and 

4) an interpolating operation means tor storing Formula (1) as the operation formula, and calculating the value 
of the interpolated image signal component Y p , which corresponds to the interpolation point X p with Formula 
(1 ) in accordance with the interpolation coefficients a^ , a k> a k+1 , and a k+2 . which have been calculated by said 
interpolation coefficient operation means, and the original image signal components Y k . 1p Y k , Y k+1l and Y k+2 . 

27. An apparatus as defined in Claim 25 wherein said spline interpolating operation means is an interpolating operation 
means for obtaining an interpolated image signal component with Formula (1). 

Y p =a k-1 Y k -i +a k Y k +a k+1 Y k+1 +a k+2 Y k+2 (1 ) 

in which Y k . 1( Y k , Y k+1 , and Y k+2 represent the original image signal components representing picture elements X^ 
1* *k+i. and X k+2 in the original image, Y p represents the interpolated image signal component corresponding 
to an interpolation point X p located between the picture elements X k and X k+1 , and a k . 1t a^ a^, and a^ repre- 
sent the interpolation coefficients. 

the spline interpolating operation means comprising: 

1) a storage means for storing information representing the interpolation coefficients a^, a^ ai< +1 , and a^. 
which respectively correspond to the original image signal components Y k .-|. Y k . Y k+1l and Y k+2 representing 
the picture elements X^, X^ X k+1 , and X k+2 in the original image, and which are set to be respectively repre- 
sented by Formulas (16), (17), (18). and (19): 

a k _ 1 =-(p+1/2)t 3 +(3p72+1)t 2 -0/2)t-p/2 (16) 



39 



EP0 798 664 A2 



a k =3(p+1/2)t 3 -(9p/2+5y2)t 2 +p+1 (17) 

a k+ i=-3(P+1/2)t 3 +(9p/2+2)t 2 +(1/2)t-p/2 (18) 

■< 

a K+2 =(p+1/2)t 3 -(3p/2+1/2)t 2 (19) 

in which p represents the parameter determining the sharpness of a secondary image represented by the inter- 
polation image signal obtained from the interpolating operation, and t. where 0£t<1 , represents the position of 
the interpolation point Xp, the position being taken with respect to the picture element X k , that serves as a ref- 
erence position, and in the direction heading toward the picture element . the lattice interval of the original 
image signal components being set to be equal to 1 , 

2) an input means for inputting the arbitrary parameter p, which determines the sharpness of the secondary 
image reproduced from the interpolation image signal obtained from the interpolating operation, 

3) an interpolation coefficient operation means for calculating the interpolation coefficients a^, a*. a^, and 
a k + 2 in accordance with the parameter p. the calculation being carried out from the interpolation coefficients, 
which are stored in said storage means, and the parameter p inputted from said input means, and 

4) an interpolating operation means for storing Formula (1 ) as the operation formula and calculating the value 
of the interpolated image signal component Y p . which corresponds to the interpolation point Xw, with Formula 
(1 ) in accordance with the interpolation coefficients a k _., . a^ a k+1 , and a k+2 , which have been calculated by said 
interpolation coefficient operation means, and the original image signal components Y k _ 1t Y k , Y k+1 , and Y k+2 . 

An apparatus as defined in Claim 25 wherein said spline interpolating operation means is an interpolating operation 
means for obtaining an interpolated image signal component with Formula (1). 

Y P = a k-i Y k-i « k Y k +a k+i Y k*i +a k-2 Y k+2 ( 1 ) 

in which Y k . 1t Y k , Y k+1 . and Y k+2 represent the original image signal components representing picture elements X*. 
i. *k. Xk+1. and X^ in the original image, Y p represents the interpolated image signal component corresponding 
to an interpolation point Xp located between the picture elements X* and X k+1 , and a k .i, a* a-,, and a^, repre- 
sent the interpolation coefficients, 

the spline interpolating operation means comprising: 

1) a storage means for storing information representing the interpolation coefficients a,, a*, a^ and el, 2 
which respectively correspond to the original image signal components Y k . 1( Y k , Y k+1 , and Y k+2 representing 
the picture elements X^, X^ X^, and Xk +2 in the original image, and which are set to be respectively repre- 
sented by Formulas (20), (21 ). (22), and (23) : 

a k -i =-{(a+2p+1 )/4}t 3 +{(2a+3p+2)/4)t 2 -{(a+1 )/4}t-p/4 (20) 

a k ={(-a+6p+7)/4}t 3 +{(a-9p-11)/4)t 2 +p/2+1 (21) 

a k+1 ={(u-6p-7)/4}t 3 +{(-2u+9p+1 0)/4}t 2 +{(u+1 )/4}t-p/4 (22) 

a k + 2={(a+2p+1)/4}t 3 -{(a+3p+1)/4}t 2 (23 ) 

in which a and p represent the parameters determining the sharpness of a secondary image represented by 
the interpolation image signal obtained from the interpolating operation, and t, where 0<st<1, represents the 
position of the interpolation point Xp, the position being taken with respect to the picture element \, that serves 
as a reference position, and in the direction heading toward the picture element X k+1 . the lattice interval of the 
original image signal components being set to be equal to 1 . 

2) an input means for inputting the arbitrary parameters a and p, which determine the sharpness of the sec- 
ondary image reproduced from the interpolation image signal obtained from the interpolating operation 

3) an interpolation coefficient operation means for calculating the interpolation coefficients a* , a* a k \ and 
a kr2 in accordance with the parameters a and p. the calculation being carried out from the interpolation coef- 
ficients, which are stored in said storage means, and the parameters a and p inputted from said input means 
and ' 

4) an interpolating operation means for storing Formula (1 ) as the operation formula, and calculating the value 
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of the interpolated image signal component Y p , which corresponds to the interpolation point Xp, with Formula 
(1) in accordance with the interpolation coefficients a k . 1( a k . a k+1 , and a^, which have been calculated by said 
interpolation coefficient operation means, and the original image signal components Y k _ 1( Y k , Y k+1 . and Y k+2 . 

29. An apparatus as defined in Claim 24 wherein said interpolating operation means, with which the sharpness of the 
flat portion is capable of being altered, is an interpolating operation means for: 

linearly combining interpolation coefficients Bij and Cij, which correspond to each other and are set for each of 
the original image signal components Yij, in two different interpolating functions f and g for obtaining two inter- 
polation images having different levels of sharpness, which functions are represented by Formulas (24) and 
(25). said linear combination being carried out with Formula (26), a new interpolation coefficient Aij being 
obtained from said linear combination, and 

carrying out an interpolating operation on the original image signal components Yij by using an interpolating 
function h having the new interpolation coefficient Aij, which function is represented by Formula (27), an inter- 
polation image signal being obtained from said interpolating operation, said interpolation image signal being 
made up of a series of image signal components, which occur at intervals different from those of the original 
image signal components Yij: 

feSBij - Yij (24) 
g=!Cij * Yij (25) 
Aij=(1 -a)Bij+aCij (26) 
h^XAij • Yij (27) 

in which i=1 . 2 j=1 , 2 and 

a represents one of all real numbers. 

30. An apparatus as defined in Claim 29 wherein one of said two different interpolating functions f and g for obtaining 
two interpolation images having different levels of sharpness is a cubic spline interpolating operation function, and 
the other is a B spline interpolating operation function. 
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(54) Interpolating operation method and apparatus for image signals 



(57) An original image signal, which represents an 
original image and are composed of original image sig- 
nal components representing a plurality of sampling 
points, that are arrayed at predetermined intervals and 
in a lattice-like form, is obtained. A judgment is made as 
to whether an interpolation point belongs to an image 
edge portion, at which the change in the original image 
signal is sharp, or belongs to a flat portion, at which the 
change in the original image signal is unsharp. Interpo- 
lating operation processes, one of which is to be 
employed for the interpolation point, is changed over to 



each other in accordance with the results of the judg- 
ment. Interpolated image signal components corre- 
sponding to interpolation points are thereby obtained 
from the interpolating operation processes such that a 
visible image, in which a character pattern and an 
image edge portion are free from any step-like pattern 
and are sharp and a flat portion has an appropriate level 
of sharpness, can be reproduced from the interpolated 
image signal components. 
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